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'"Chapter "i ■ • .53? ^ 

Intro^ction . -li - ^ 



'This report presents tie results of quantitative analyses ' ' 
• undertaken as ; part of a ■comprehensive evaluation "of NSF's Local Course " 
Improvement (LOCI,) program. The report is 'the second iii a three- ■ 
.^volume set describipg. results-;of the evaluation.'- The fim volume 

presents an overview of the evaluation and provides a summary of all^ >■ 

■'^"'^ ''"^"^ describes detailed fiiidings from ' ^ 
vif£t^ to institutions that receiv^doLOCl awards. ^ ' ■ 

.... S/ ■ ■'• A. . •■ ■ - - . ... ■■ ■ • ■• • ■ 

• L6CI is one of -a^ number of programs through which NSF's Division / 
. tof Science Educatio"n Resouicgs ,Imf)rQvement; provides supi)brt to ^ '. " 

. ' strengthen the capabilities of schools, colleges, and universities for V 
science education and research training .\:LOCI helps :Golleges_and ! , 
■ universities improve their science^instruct:io■nal efforts at the level' 
,of individual courses or small groups of courses. The 'program 'v ' - ' 
provides up to two-thirds of the total qo^t of .a project fo^ maximums ' 
^of $25,000 and two years. In 1976 LOCI receiyed 169 proposals and ' ' 
-funded 66, with an average award of $13,600. In 1977 tHe program ., 
received 750 proposals and funded 129, vith an average awatd -oi^' ' . ' 
$17,000. -In 1978 it received 453 proposals and^ funded 1^5, with an ' 
average award of $16,700. 

In July 1977- NSF requested proposals from educational - ,. 

institutions and^ research centers for the evaluation of its LOCI 
♦program. The request for prb^posals specif ied a. project that would - 
answer questions in several areas; 



1) Need for support'^for local course\i^rovement~Wh evi$lence 

■ • • ■ ' • ■ ' r ' •. 

exists that institutions need .'out side assistance 'to keep up 



'developments? How do needs differ in different types' of 
' institutipns and, in different scientific^ fields ? v 

2) Response to LpCI---l)o* applicants for awards represent 'the full 
tange.of institutions and scientific fields? Are pxajpo sals 
and funded prbji^dts consistent with- established needs for . 
instj'uctiona'],' imprdvemerit? ■ . * ' ^ 

3/ Outcomes of 'lOCI prd&ram--To wJiaf extent, do provjects Achieve 
: their objectives? Which , sorts of* objectives are p^ost often ' 

r • achieved.? What their;:" 

' - --n:' " ■ *■ ■ ' ■' ' ■ • • ' •. ■ • ■ ■'■ ^■■ ■ 

\ . succes?? What are the most' promising practice'^' that- have 

been, de^loped in LOCI projects? V ' ' ... " 

^^4) PrograA rationale— Are .iJrqgram guidelines' and restrictions. 

. r^erasonable? Are level of support, degree o& structure, and 

. . ' ."• - ■ ' ' ! ' ' ■ • . ■ ^ ' ■ ■ • 

* ;tijne allotted adequate?/ What other alternatives ate there? ' 

On the basis of our response to ;this request for proposals, we 
■received a preliminary award ^td plan an evaluation of the LOCI -program^ 
in Sept ember ^1977^^ 6£ the vFTlan we *; submitted in January 

1978, we received an award to. carry out a,* comprehensive evaluation; 
The project was carried' out ! in. the peridd of September J 978 jbiro 
March 1980. : " ' . | - . . ^ . 

To answer the questions posed by JNSF, we collected data using 
several diffiefdnt methods with several: different populations. Td. draw ' 
conclusions about the /need for local^^course improvement, for; exaimple, 
contacted a rfepresentative- sample from the total population of 
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.teachers of undergraduate stience and engineering .v To determine / 

. we used NSF documents to •construct, profiles of proposers and of award 
recipients, and we compared these, to a natUnal profile of college • ■ 
Science.teachers and-to Clie' picture of needs ;dev?l(ii,ed in the first ^ 
part of the project. To determine whether program guidelines were 
^ .ajypropriate, we read, classified, and analyzed .propqsa Is 'funded by NSF 
diiring the yea^s -1976 through 1978. To evaluate but comes of LOCI ' 
. projects, we analyzed questionnaire responses and final reports ■from' ' 
^iteCtorW of completed^inrojects .v , We also riiade" site visits a ' 
^representative sample of these- piojectis. 

This yolump rep<)rts;all results except those , obtained d|ring the" 
site iyisits. Chapter 2 presents the results from the survey' of a ' 
, national ^sample of college; Ici^ce teachers on needs ior local course ' 
improvement,. Chapter 3 presents the prokle of applicants for LOCI '. 
, awards . CJiapter 4 gives a description of recipients; of awards and 
also describes their LOCI projects. Chapter 5 describes responses of ' 
pro-j,ect directors and chairplrson^^;^^^^^^ 

questionnaires on LOCI project outcomes, and chapter 6 describes the ^ 
LOCI outcomes that project directprs documented in their final reports 



to NSF. 



/ : • Chapter 2 

. Needs arid Resources in College Science teaching 



The fii^st goal in our evaluation of the LOCI program was to 

■ ■ . ' .'. .' ^ 

determine whether college science teachers could keep'up with ' 

< *. ' • . ■ . 

currently important scientific and instructional .developments without 

outside help. Do college teachers think science courses . need 

improvement? Do they think that resources like those provided by LOCI 

'actually help improve teaching? Are resources like those LOCI 

^ ■ : provides available to science teachers ftom their o.wn colleges and 

:.: universities? Do needs ^^^a^^^ resoiirces^dif fer .in different types of 

institutions and in different scientific fields? 

This chapter gives out answers to isucb questions. It reports the 

results of a survey of opinions of a national .sample of college 

■ . *' ■ ■ ' ■ 

science teacher,?. The survey covered three areas: needs in college 

. science teaching; effectiveness of various, resources in improving 

^^instruction; and availability of these resources locally./ 

* *; / " ' • . Method 

Questionnaire « \ * : 

. ; The questionnaire developed for. this survey f contained nine items 

Qn^needs and six itjfems,on resources in college, s-pience teaching 
(Appendix A) . The quest i^onnaire alsa asked faculty members to provide 
, . infbrxnatipn about themselv^sr-highest degree, academic field, rank, 

and recent undergraduate teaching responsibilities. The questionnaire 

' - • ■ ■ . • • • ' •'" , .■ . , . f ■ . ■■ ■. 

Was designed* to require no more than 5 to • 10 mindtes f or completion. 

■ ■ ■ fl . ■ . .■ • \, / - ■ . ■ ■ ' . ■ ■ • ' 

• . • . • ■, . .. . . • " ■ ; ,- r ■ ■ ' ' ' : 
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The nine. items on needs in science teaching' fell into three 



____.groups.:.^need--f<>x-^se>nd-curricu^ 

teaching -methodology; and need- tp improve educatiotia,l- putcomes 'in such ' 
areas- as student achievement,, student. satisfaction, number of . ' 
enr.ollments,.number of dropouts; and service to adults in the : 
. • community. For each of the Vine" items, respondents were to indicate • : 
degree of peed' on a. fouiT-point. gcale: -strong need, io^ate- need ^ 
slight need, or no need at all.'' ^' 
' \ . .The six Vesources listed in the que^^^ released . > 

time, summer salary, travel. funds, small. ^^^^^ ' 
consultation,. .and paid assistants. ■ Respondents were , asked. to indicate 
; :.the. effectiveness of, each of these resourc.es on a four-point scale ;^ 
-.high- in effectiveness, medium, low, or not at'all. Respondents were ■ 
■': •'*l-.?o.*.8ked,to indicate ;t^e.>yailab£lity of each ofthe tf^sources -on a ' 

W-ppint scale: - big)i iii:^av^ilabilfty, medW, low>qr'not at'alh 
^ available. - « ' \ . ' - 

> ^ f ■ ■ ■ * ' ^ f- ^ — . . . • 

' : ■ .■ ■ . ■ ■■•'-•^ '■■■.I ■ ■ " ■ . ■ , . ^- • ■ ■ 

■ ■• ■• Sample . ; ' V- . , ■ .,■ • . ; ■. ■ . / ■ '■ V ' ' ^ 

■ ■ ^ ■•• .p. V ' ■ ^'i^' ' ■ ^ " ■ ■ ' ■ 

.. - The Questionnaire was mailed to a nationaV -satapie ^f ' co^ 

science tethers iTn MaV. of 19 2649 ^" c. 

^I'^^^^h^". ^bout^jieo^h of the science teachers list fed in the ^National, / 
' : Faculty Directoi^. (Gale :Publishing, 1978) . S complet^ questionnaires' / 

^were returnexi' by.833 of^th|^in(^^^^^ 130 ., ; 

» ■■■■ ■ ■ - ■ ■ . ■.■ . ■f:<^ ■ ■ ■ . A ■'■ , 

questionnaires were returned'^f^vfs, either unopened.'or without. 

responses,<iby the. post office o^r&indiVidiaals wh^ had received ^ ■ 
. : them. Envelopes returned by the^Sl^f^e b&e j^^ous notations:' ' ' ' 



inadequate address or -addrelSsee urikl^n^gc^i^l^' left' the 



institutioiT without leaving a .f o:fwarding addr&^ ' Questionnaires: 
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without, responses retiirn^ed by .individuals ''^ntained other 
_exixl ana t ioris.:_ j;et ired., or -faot^i-t e^ 
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. made no further attempt to get resppnSes from i|idividuals who were /not) . . ! 
at institutions listed in t'he : Faculty Direq torv of .'who^'tjprp nnf " ' ' - , ' 

; ; curi:ently teachers^ Ofi, undergradua«;e science . ,,' ^ . ■ ' 

In Novembfer of 'I979.we sent 4 second copy'oKthis questionnaire . '■ 

t6 the 1686 individuals who did not .respond to the fir s^t mailing .^:'> Two 
weeks af;te.r the mailiag of questionnaire, we sent out\eminder ' . < " 

postcards, to all nonrespondents/. The' second mailing yi^ 

■ •' \, ■■ ■ '■ "'^ , '■; ■• 1 • ■ : ■■ - -■ ■. • ■ ■' ■■ /■■ 

additionai;4?9i complete|. questionnaires for the analysis. Qf the . * 

V ■■ - ■ . ' , i-- . ■ ■ ■ ■■■■■ ' ■ ■'■ : ■ 

-teachers of undergraduate science successful ly contacted by'us in the ' i'i^V" 7 
• two. mailings, a total of ^ 1^2 Xo^ returned, questionnaires . . ■ 

Ad:equacv of the Sample ^ - ' 

^ To determine whether the indi^vidtials returning questionnaires ' • 

were representative of the sample 'sjarv eyed, we carried out' two maiof - 

analyses. The firSt compared characteristics of respondents and 
. nonrespondents to the questionnaire. The second compared resptfnses of ' . 

the. individilals wJio f ilied^uTThe ^ irst- qu^ responses . 

:of. iudiyiduals w^io delayed answering un^ receiving . a second . 

quest tonnaire . \ / ■ ^ - ' 

The, compariso.n of respondenta and nonrespondent^ -focused on • 

institutional and. departmental affiliations oJE the two gr6ups / We 

first classified tfie ins^ all'-;individuals x;ii the total * 

sample accprding to' level and pontrol, based on data available from 
:^ • • . . ' "'^ ■ : ' . ■' ' \ 

th6- National, Center.-.for, Education Statistics (Pepin^ 1978) . ' We ^then 

. : : ' «■ ■ . . , ' ■■ ■ 0 ■ • - ■ . ■ • .■ •■■ ■ 

■ . ■ •■ ■ ■ ■ ■. ^ • • . • - ., ^ . ^ . ■ ■ . • 

classified the departmental affiiiatidns of /these teaciiers using th^ 

dimensions ^developed, by Biglan (1973): pure.Vs applied^ hard ."-^^ ;•. 



VS. soft;, a,nd. life vs. non-lif^. In Biglan's taxonomy, engineering 

, and computer sy.ence are applied sciences ; psychology and the 

' ••.*■. 
phys'ical, mathematical, biologi<jal^ social, and environmental sciences 

- . . ■- ' ■ -■ ' ■ ' • , . . 

are pure science? Psychology and the social sciences are soft; the- 

others are hard sciences. Biology^ psychology, and the social 

sciences are life sciences ; other sciences are non-life. 

The results 'Of chi-square tests comparing respondents and ■ 

•• ' ... « ■ ■' ■ ■ ' ■ ■ . ■ 

nonrespondents appear in Table 1* Neither level nor control of 

institution was related to return of questionnaire. Individuals at 

public. and private institutions and at two-year colleges, four^year 

colleges, apd universities were equally likely to return 

questionnaires. Departmental characteristics , however, were related 

to return of" the questionnaire. Teachers in psychology and the social 

sciences - were les-s likely to return questionnaires so that: the- soft 

sciences and the life sciences were somewhat: underrepresented among 

. bur^J:espondents . ■ ^ v < . : • \ ^ 

Further analyses . suggested,- however , that the underrepresentation 
of psychologists and. social scientists among respondents did not 
seriously damage the generalizability of our results . These^analyses 
showed that responses of psychologists and social scientists to our 
questionnaire items were indistinguishable fr^™ responses made by 
other science teachers. A healthier response from psychologists and • 
social scientists or a lesis. hearty response from other science 
teacher a Would not have <:hanged^^ ^ picture of needs and 

resources.^ _ . 



pur second major analysis compared fgj,Bo»s^s of those ling out 
the first questionnaire and those filling x)ut the second 
questionnaire. There was\little difference in. the answers^of the two 
groups. The average response 'to the need items, for^^^cample, was 2,8 
for those responding to the first mailing, «and was also 2,8 for those * 
responding £0 the second mailing. The average response on resource 
effectiveness items was 3.0. for the first mailing, and also^3,0 for 
the second mailing, The^ same pattern' occurred \_ 
availability itemsr an avey^ scor e^.of tiie. mailing^\ ' 

The implication of this analysis seemed cle^ar to us. Those who 
responded immediately to our request for 'information did* not differ in 
their perceptions of science teaching from those who responded only 
after prompting with another questionnaire and postcard. Likelihood 
of responding did not seem related to perceptions of needs and 
resources in science teaching , This analysis gave us 'some confidence 
In generalizing our findings from respondents to the total population ." 
dpntacted by us. We could find no reason for believing that needs of 
nonrespondents were more or less pronounced than the needs of those 
who did respond. .\ 

Results 

Overall Needs and Resburces ^ • 

In thiS' part of the analysis, we examined overall perceptions of 
needs in science teaching, resource effectiveness, and resource 
availability. 

Needs, Respondents generally. reported strong : pr moderate needs 
to improve the content, teaching methodology, and effectiveness of 
science teaching at their institutions (Table 2) , The number. that , * 



reported strong needs was especially striking. " Fully ohe-quart'er of 
all college sci«^e teachers said that courses in -their departments, 
stron^lyj^j^d revision in content or teaching methodology and that 
teaching: in. their departments needed to* be improved in effectiveness. 
Anotter third of the respondents reported moderate needs in J:hese 
areas. A minority of teachers reported slight or no need for ~ ^ 
improvement of science instruction. 

■ IJhe teacher^thar we contacted, gave almost equal emphasis* to the 
ne^d for.«pxiiatiflg;'^ntent and the ne^dV f 6r^ rSviSrii teaching-methods ' 
in science teaching. Respondents who reported an. urgent need to ^ 
update course content made written comments like these: 

There is an overall need to (l) bring in developments in ^ 
archeology, human origins, ethology, and social modelling, and . 
u; to re-state them in a reliable, concise, and intelligible 
way The g-eneral educational significance of modern anthropology 
must be carefully maintained without being swallowed by technique 
or fragmented-and this is difficult. Here is a valid area for" 
WSF projects. (From a teacher of anthropology at a public 
university.) • 

Physics and chemistry are in need of reexamination. Stars 
probably do not generate radiant "energy by fusion; the atom 
probably is not made. of elementary particles and has no nucleus: 
physical entities go faster than "light" not in space but in 
time, -etc. (From a teacher of physics at. a foixr-year college.). 

Some of the teachers who emphasized the need for revision of teaching 

I' *. ■. ; ■ . . ' . \ . ■ . ■ ■■■■■■■■ 

Methodology commented on the difficulties in using instructional ' . 

techhoTogy^-— . 



Optimum use of instructional techiiology t^es LOTS of preparation 
time._ An effective establishment of one good. course's worth of 
existing technologies would take AT LEAST a year's fulltime work 
beforethe start of the course, and another year or two of 
debugging in use. After that, updating and revising would be no 
more of a load than preparation and updating any ordinary course. 
Naturally, we don't get that kind of support— so we've never made 
properly effective use of the technological tools we've got. 
Problem is as much one of software as hardware. (From an 
anthropology teacher at a public, four-year college.) 



.10 ■ _ ' 

Many respondents reported -a heed to. improve the effectiveness of 
science teaching, but they did not agree completely about which 
outcomes needed improvement .. There was most agreement about the need 
to increase student mastery of scientific concepts. Over 50% of. 
science teachers reported a strong heed for increasing student 
achievement ^^and an additional 33% reported a moderate heed. There 



was lea*st agreement about the need to increase enrollments aBd 

decrease dropouts., As many respondents reported strong needs to 

■ increase enrbllmenlts or decre^e dropouts as reported no need at^'all/* 

Writiten CQimnents reflected the split in opinion on enrollments 

and dropouts ^ , Some teachers identified enrollments and dropouts ab 

key concerns; . .r 

We are losing far "^oo many high school students. (From a teacher 
of sociology at a public, .two-year college.) 

There is a strong heed to reach more students with new ideas and 
developments in science. But this must be done with maximum 
effectiveness, to keep costsas low as possible. (From a physics 
teacher at a public, four-year college,) 

Others did not see any problems in the area pf enrollments and " 

dropouts: , v 

A need to increase enrollment? For what purpose? (From a 
teacher of mathematics at a public, two-year college.)' 

•. If good students dropped ouit or poor students who could be helped 
dropped out, I would favor decreasing dropouts. I see no reason 
to retain those who fail to achieve because of laziness. (From a 
biology teacher at a public, four-year college.) 

Several teachers wrote that the nine items listed in our 

questionnaire overlooked an important need in science teaching today: 

There is also a need for a science core requirement to' insure 
reasonable sophistication in modern science for liberal arts 
students. (From a psychology teacher at a public^'university.) 
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Item 10. and very strongly needed: Wveloping a' coherent program 
•to provide non-science liberal arts ^students with a degree of 
literacy and competence in mathematics and the sciences, with 
understanding of science as .a highly selective way of viewing . the 
world,- and with appreciation ofejtlie perspective thus provided. " 
CFrom a mathematics teacher at a private, four-yeap collfege.). 

• ■ '• ■ ' \ ^ '* ■ ■ ■ ' ' ■ ■ -A 

^ Resource effectiveness. Most respondents reported that resources 

like those provided by the LOCI program are effective in improving 
instruction (Table 3). The resources that received the highest 
ratings were ^provision of summer salary and released time'. Nearly 
half the respondents to the questionnaire rated released time or 
summer salary as highly effective ways of improving science" teaching 

•Small grants. to support teaching effectiveness seemed almost as 
effective to respondents, to the questionnaire. Over ^a third of the- 
science teachers rated small teaching grants.as high .in effectiveness. 

Ratings were more 'i^derate for travel funds, paid assistants, and , 

consultants on teaching" improvement . About half of the respondents to 

the questionnaire rated these resources as medium effectiveness. 
. Written comments of teachers about these res6urces explained 

their ratings. Many of the comments emphasized the importance of . 

additional time for course improvement: 

At this time of declining enfollments/our- college should— but. 
doesn't—give released time for course revision, course 
attendance, seminar participation.,- We need— at the community 
college level— to convince the governing board of the merit of ' 
; retraining and upgrading of skills and infotmation. (From a. . 
sociology teacher at a public, two-year -college. ) ' 
■ « • ' %• ■ 

: At an institution such as this, where teaching is considered 

marginally more important than research (dnd one can argue that 
such an institution provides the most fertile ground for genuine 
advances in. science teaching) the, conflict between time spent on • 
teaching and timd^^ent on research is intense.. . Thus the extreme ' 
.importance and effectiveness of released time 'for working on 
course improvement. (From a teacher of math^atics at a private 
four-year college.) . .' 
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Although most teachers said that more time jnd pore resources 

were needed for' teaching J.mprovement , a minority of teachers' wrote 

that additional resources w^ere not neededT— rSome of~these teachers 

wrote that additional resources were far less important than the 

dedication, initiative,, and quality of the teacher:' 

A dedicated^eacher will do most of the above with no help or 
guidance. Some who regard teaching- and the continual effort to 
improve teaching with less dedication may *.need , many of the above 
helps and, prods it could be useful 'in improving the quality of 
an average teacher or PT7on gno£ ho^nti;.T-w-nnr necessarily the 
dedicated professional teacher.^ (From a. biology teacher at a 
public,^four-year college.). ' V 

personal initiative is mor6 important than any/of the above. 
(From an economics teacher at a .private university.) ' - 

^ Others explained that attitudes of administrators ^ward teaching' a^nd' 

rewards for good teaching ^ere morg important than institufe^nal ^ 

resources: 

To impfove teaching, - create incentives to r^feward 'excellent 
teachers and. punish mediocrity (not jiist horrendous^ teaching) . ' 
The incentives to use resoui^ces to improve teaching are not . 
present. Resources to improve resea'rch productivity are used 
because the incentive structure provides clear rewards., 
Improvements in teaching must take tijne away from publishing . ' 
So, why improve teaching? (From^a teacher of political science * ^ 
V „ at a public university.) ' . . 

, .The real problem is we -are a 'ipublish or perish" institution.' 
, , Onljr research productivity counts for survival. Good teaching 
might help only as a selection criterion among "matched" high 
publis^hers. Good teaching, requires ^preparation, time and work. 
Until these are not o'ftly provided, biit rewajrded, there will not / 
be any improvement. (Frpjn.. a teacher of psycholb^y at a public, 
four-year college.) • \ - 

Finally, ^ few teachers suggested that other resources were just 

as important as those included ori^our list-. Important additional 

resources listed by respondents -included funds for equipment: ' • 

.Most course improvements in chemistry.mtxst center on equipment or 
access to equipyent—e.g., computers , spectrometers , etc. with 
acquisition <;ost3^s in the $5,000-$50,000 ringe. 'it seems to me 
that NSF^'s approach has been , schizoid— programs for instruction 



^- . and otherslfor instructional equipment. When we revise a course 
. the costs^dre mostly in .hardware not staf f planning time. I 
; belieye thJs true of small schools in general. Chemical 
. education nUeds $$$ for instrumentation more than any other- 
ttjting. CFrt)m a chemistry teacher at a private four-year 
college . ) 

Other respondents wrote that institutes could play a large role in . 
improving undergraduate science teaching: 

; Summer institutes ("refresher" courses, or "new stibarea" courses) 
..V Pj"!,?"'^^^ scale research opportunities (either independent or 
affiliated with larger projects) are of great importance. to 
teaching^oriented .undergraduate faculty.' (From an anthropology 
, teacher at a private, four-year college.) ^ 

Js/?n^7^fT^ "^""i' '° ^^^P' -they, should reinstitute the summer 
^NSF Institutes-. Many would, attend without any stipend if 

"■- K-^?"'''.^^"' travel, room and board were provided. (From a 
biology teacher at a public, two-year college'.) : \ ' 

Resource Availability . ^^^jS^ey respondents reported that 
resources like those LOCI provides were either unavailable, or low in 
availability at their^ institutions (table 4) . ■ Interestingly enough, ' 
the two items reported^ to- be least available '^ere those considered . 

most ef'fectiye by respondents: . summfer salary and te leased time'. . 

Nearly two-tl^ir^is 6f all respondents 

at all" available for teaching improvement projects; . nearly half of 
all respondents said that "released time for such work was unaVatlable 
during th^ academic year. Other items (i-re., -travel funds^mall 
teaching' grants, consultation, and paid as^sistanjts) were available.to 

more-. respondents, -but .overall ^ere still low in avaiiabiUtyj . 
. Written comments from teachers in all fields and. in a^ll types of 

institutions emphasized the lack of resources for teaching 

improvement: 

Our .de^artmenij barely has enough funds for instruction and ■ 

secretarial- support aixd almost none for new ecpiipment. Resources 

off ^ -^/""P!-^""^^^ almost nonexistent. (From a teacher 
of electrical engineering at a public university.) 



\ ^difficulties In trying to do tea6hi^g,;^and research in a graduate 
- degree granting institution are not recognized. Everyone would 
like to improve their teaching, but no incentives are available 
in. terms of time or money to do it and students are becoming more 
!and more demanding. (iProm a geology teacher at a public 
university.) ^ ' . * ^ , 

Funding is so severely limited in community college districts in 
^ .this state that upgrading of courses is' entirely dependent on the 

enthusiaism of the instructor. (From a biology teacher at a 
•V public two-year college^) 

At this university teaching improvement etc. has been .done on a 
catch-as-catch-can basis. There has never been any reali^stic < 
^ support fpr teaching innovation, althc^gh such is to be desired. 
.(From a- ch'emistry teacher at a public university.) 

Some written comments stressed time pressures that faculty face 

today. Many teachers said that they needed time to plan and, revise" ^ 

courses, and that released time was. not available at their 

institutions: . . ^ ^ 

What I need most is released time . Our ^undergraduate chemical 
engineering enrollments are very- large, and increasing 30% per 
year. We simply cannot find the qualified fdculty needed to 
effectively handle this load. Also, for some reason we do not ' 
" have many paid TA positions in our department. The result of^tffl 

^ of this is a very busy academic year "for our faculty. (Froi^^ 
V teacher of chemical engineering at a public university.) ' 

^^,:i^fy^ i5 credit' hour (or efquiva lent)- teaching loads at this - - 
: Institution. . With suchjie^y loads, few people have much time to 
even think, much less contemplate improvements. Thus only during 
the summer is it at al/l practical to plan improvements. 
Nonetheless, few people devote their summers to such activity. ,.' 
Most take, other employment. (From a physics teacher at a publicj 
four-year college.) . . 

Differences among Institutions and Fields 

In this part of the analysis, we tried to determine whether 
perceptions of needs and resources were different at different types 
of institutions and in different fields. 



^ part: of the 

. questionnaire correlated highly wif h each other, and factor analysis 
- showed, that a single factor ran through' the items, and explained , the ' 
^high intercoi^relations. Vwe felt justified, therefore, in sunmiing 
together all scores on, the need items to obtain a total need^score.- 
The alpha-reliability of the ^otal need score' was .6S. We. osed^ 
..stepwise multiple regression to determine whether total need Scores ^ 
differed atMifferent types of institutibns .and in different" fields 
Level of institution^ turnid out to be 'relited to perceived nieds^ The 
correlation.befeween institutional, level J^^^^ was' .22. 

Perceived needs' ;,werW highest at coiniminit.y cp lieges (mean/it.em. 
. endorsement = 3 .0) , lower at -four r-year colleges (mean. = i.S); and^ 
'lowest at ..universities' (mean = 2.6). Other instituticynal^^nd ' - 
departmental, ciiaracteristics.;wei:e not telated to iperceiV^ nee^' for ' ' 
instructional improvement.; " . ' 

Resource Ef f ectiveness ..<The six ^itgms on perceived effectiv^ess 
of resources' also correlated highly with one another, and again we 
found t?hat one common ^^ctpr ran through ■ thes e it ems . We" therefore 

.summed all scores on the effectiveness iten^'- to obtain an overall 

■ ■ ■ v., , ■ 

.•effectiveness scale scare for each respondent . The alpha-reliability 

of this overall scale score was .76. Institutional level again turned 

out to'bethe factor most strongly related^to scale score. The 

correlationSitween institutional level and perceived resourck 

effectiveness, was .16. Resources were per c<^ived as most effective at 

two-year institutions (mean, item endorsement = 3.1) and at four-year ' - 

colleges (mean = 3 .1) ; Resource scale scores, were somewhat lower at" 



-universities (mean = 2/9) • Other ins titutidbal -and ' departmen^^^^ 
characteristics were not significantly related to perceiyed • >- 
effectiveness of resources, ^ 

...^-'^ Availability. Based on the results of a third factor analysis) 
summed together scores o;n the six items pn availability of • ,( 
instrudtional resources. The alpha-reliability of the -overall - 

. ' ■ ■ ' . ■ ■ --'^ ■ ■ ■ ' • * V 

avaalability scale was .6?. Regression analysis failed to uncov^^ny 
institutional or departmental characteristic significantly related to 
availability scale score. \' • - - " 

OtHer Dif f ereric'^es - ^ '\ 

In crur filial analysis, "we tried to- determine whether individual 
characteristics ofS^espondents ^re related to their perceptions of 



needs and" resources. ^he. five characteristics of reepondehts that we 
Examined were: highest degree,' academic rank, chairperson status, ^ 
administrator -status, and\whether or not the respondent taught, 
undiergraduate. courses in the past year. We used stepwise multiple 
regtession to determine whether these characteristics had an influence 
on questionnaire respans^s after we controlled for effects of 
institutional level. Results were . clearcut . Although individual 
characteristics could b'e used- to increase predictability slightly, the . 
amount of Variation explained by these" characteristics was trivial in^^ 
a practical sense. Responses of groups with^'different degrees , at 
different ranks, and with different ^amdunts of undergraduate teaching' 
were virtually indistinguishable. 



. ° Sunmai^ and Conclusions ■■ '/ '.■•■ 

The college science teachers we contkcted generally reported" 
strong or moderate needs- to- iigptovg the .content, teaching; methodology, 
and ef f ectjLveness. of science teaching their institutions J Fully ' 
^ one-quarter, of all college, science teachers 'said that courses in. thejtr 
-departments strongly needed revision in content, and teaching- . ' 
methodology and " th^t teaching in thqir departments also needed to be 
• improved in effectiveness. Another ^third of .'the survey respondents ' 
reported moderate needs in these areas.. ;A].minority Of •teachers ' " 

reporte.d -slight pij^nci^need f or rimpVoVement*> o^^ science teachiS^T^ .. .' 
^ , The- teachers we contacted Viid\iat k^sign differ,ent priorities ' to •. 
revising teaching methods and updating' cbhtent of science courses . / 
Both tasks seemed -important tq^em.' But respondents did BtreSs, some 
educational outcomes more than o^^.\ They report ad. that'-the ," - 
greatest heed w^S to increase 'student 'learning, : but they,. also reported 
a strong, nged to inprease student. -satisfaction in' science courses . - ' 
, They gave somewhat lower priority to^increasing .enrO^llmeats and . ' ■ :^ ^ 
community service and decreasing.ctourse .dropouts. • ' ' 

According to^ these teachers, resources jof the -sort provided by,, 
the 'LOCI program- are effective in improving instruction.' The 
. resourbes^.that received the /highest rating? were provision of s'umier :: . 
salary ^and^released. time. -' Larly half ' the respondents to the survey 
quektioianaire rated, released^tto^-or^^ as highly ef fecitive ' 

in improving science teaching.. .- Small grants to 'support teaching 
•effectiveness seemed almost as effective to respondents to tfie • " 

questionnaire. . Ratings were mpre; moderate for travel funds /paid-' 
assistants, and consultants on teaching improvement:.. ; • v " 



. Teabhers in our survey' said,, however; that these items. yere • 
6lther unavailabig^ or- ld% iir aYailabil'ity at their -co lieges and - 
universities; The two items reportred' to be least available were those ' 
considered most effective by •reVpondentV: summer: salary aad rele'ar&d^ 

■ : . ■ . ''''■:■'■[- '-/'v-:''::;''- ■ .. .. \ \ 

time.. N*early .two-thirds of all -respondetits: said that "s'uiiaer..saliary ; - 
was ."Afft at afl" available for .teafztiing- iriproVement pro ject? ; neaE%>«- .\ 
.half of all respondents ^sSdd that released time, for 5u^ch Jprdjects wlf^ 
unavail-able'.during'fthe. acaddmi^^ year.. Oth-er 'items ;(i.ew',-:tSv 
.; funds /sinallteacHng'g 
. >^ailable: 4:o^kore^^x but pverair were* itiLl.: cohsi^ 

in availability. . ^;^ - . ' •: •>'!-'. . ^ / . > 

Jre.fceptK^ns o_f nefeds and r%s our ces;. were "^sdmew^ at 

' " " ' ■ ■ • ' ■' * ■ ' ■ . • 

^ different institutions*. Perceived needs were highest at community ' 
.colleges , lower at four-year cd lieges , and lowest at- universities . 
Bespurces^of. the type Lbdl providers Vei-e perceived'as most effective 
by teachers' at community" colleges and fo«r-year colleges a»d were • ' 

<■ \ - ■ . ' ^ ^ : -.■ : .; ■ ■ ■ • : ■ ' ■ '■ ^ ^ ■■ 

seen, as som^vhat Jess efjtec.tiye' by /faculty. nlembe;rs at linivejrsities . 
Ayailab^iity of ^theaeVresources was reported to" be Equally low by V 
teachers.,at i%l levels of institutions: ^ ^ \v ■> 

N Perceived needs and resources wer:e. very similaj inv dif ferent 
areas of . sc.ienc^e.'' Te^achers in' hard. -^ni; soj^^ applied, life 

and nonlife sciences reported; ^imilar.-'degrees of need and similar - 

•'. • " • ..^.-.^ ■ ' - . ■ ■ / 

perceptions of .r.esources' in. college, ^.cietice teaching. ' Individual ^ 

cparact^ristios of teachers also :we're unrelated to perceptions of 

■ . ' " ■ ■ '* ^ . ■ ' ^ ■■,..*_'•. 

.needs- and' resdurce^s. Groxips of 'respondents with different degrees , at 

different ranksv , and with 'different undergraduate, teaching 

responsibilities ' gave .simiUr r^ our isurvey questions. 
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CHABACIERISTICS OF RESPOHCEliTS AMD NONRESlipEMTS 
. TO ;THE needs oaESTIONlfiilRE ^ 



} I I +— — 

Control oMnstitu^^^^ { I j \] - I ' ^ 

% : ■ j. JJI i ' 1. Tr.8. l o.Oi. ^r „3 
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Hard vs. '^oft Sciences | :k • ■ ! I ' " ' ^ ^^^^^^^^^ 

.Hard V • [ \ ' T j . 

I 2B.7 I 1)99 I ; 40.J) I | t '.. 
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Life ' • ' - I } • j ' 
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SCIENCE TEACHERS^ :RAnNGS OF EDUCATjimL NEEDS: 
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Need 
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Need 



More Technology .^.^ ■, j .j 



Updating;: fpogramS' 
Mqre 3tudent Mastery 
^Icir^efSatisfact 

; We Enrollments 
Fewer 'Dropouts , 
More Coianmnlty Service 
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SGIEWCE TEACHERS' RAHNGS OF; THE 'EFFECXIVENESS 
. OF EDUCATIONAL BESOURCES / 



TABLE 4 



SCIENCE raCHEiS< RATINGS OF THE AVAILABILm^ 
— - - OP-EDUCATIONAL-RESOURCES-' - : 



Item 



I Not At All I Low 
I (1) J (2) 



I Medium I High 

I .„... —■ ' I' C) 

' i M I , ? 1 N I ? : .T7T7"rrrT' 

^ -p— —.+.._.„+. — ,.+„„.^ +-—.+.—..+.„.+...„ 

Releaae^Tlie' . jV 594 | 48.1 j , 63 I 37.5 1 154 I 12.5 I 23 i 1.9 

:Summer Salary } ^n | 63.7 { 326 1 26.7 I 85 I 7.0 1 32 | 2.6 

W. Funda ' I | 40.0 j 543 I 44.3 I 168 I 13.7 [ 25 I 2,0 

^Small Teaching Grant? | 373 1 . 30.5 I 56l-| 45.9 ! 245 I 20.0,' 44 I 3.6 

Consultation . ' l 404 I ; 33.4 j 537 I 44.3 ! 219 | 18.I ^ | 4.2 

i ,1' \\ I |., I I I 
512 I 11.7 1 454 I 36.9 I 212 117.2 I 51 I 4.1 

' ' :■ I ■ I I I I 



i 

^1 



Mean 



Paid Assistanta 



I 

I 1.68 

I 

I 1.49 
I ■ 
11.78 
I 

11.97 

r . 
1 1.93 

I 1.84. 
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.. ■ : \ Chapter' a • ■ ■ 

Applicants for LOCI Awards 

. ■ . * • ' • ■ " . 

The next major goal in the evaluation of the! LOCI program was to 

"rdeterS^Lir^whethrr"^^^ 

institutions and fields. Did applicants for LOCI awards represent the 
-full range of institutions and scientific fields?' Or were certain 

types of institutions and fields unrepresented or underrepresented in 

LOCI proposals? Did certain institutions and fields submit more than 

their share. of. proposals? 

To answer such questions, we first classified the proposals 

submitted to the LOCI program by institutional type and scientific 
field. We then compared the number of proposals received from each ' 
type of institution and field with the number expected on the basis of ' 
popuUtion characteristics . This chapter presents the results of 
these comparisons. 



jMethods 

Lists of proposals submitted during. the period 1976-78 were 
examined .for this study. ;The lists contained identifying -data on the 
1358 proposals received by NSF during this period: 163 proposals in- 
1976J 742 proposals in 1977; and 453 proposals in 1978. Included on 
the lists were names of institution^ submitting proposa.ls and . 
departmental affiliations of proposed project directors. - ' . 

We first classified institutions submitting :proposals: according 
to their level,, control, and . traditional background at the 
institutions: - ' 
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a) level— We used the classification published by the National 
Center for Educatibn Statistics (Pepin, 1978) to describe 
institutions according to level. Institutions were 
classified as either universities , four-year colleges, or 



:two-year colleges. 

b) Control— We again used Pepin's (1978) piiblished 
classification to describe institutions as either public or 
•private.. J 

c) Traditional racial background of institution-^-A list^oS^ 
traditionally black institutions, compiled at the National 
Center for Education Statistics (Turner and Michael, 1978), 

.was the basis for our classification of institutions as 
. either traditionally black or other. ' 
We also described the scientific 'field and area of each proposal, 
using both traditionally defined fields and ! three dimensions defined 
by Big lan d 973 ) . ;\Thise dimensions were: 

a) Pure vs. a^lied~I^ and 
computer science are applied; psychology and the physical, 
mathematical, biological, social, '^nd environmental sciences 

•are pure sciences. 

„••'«. ■ ■ '■ • . * ■ 

b) Hard vs., saft—Psychology and the social -sciences are soft 
sciences; the others are hard sciences.. 

c) Life vs. norilife— Biology, psychology, and the social 
sciences are life sciences while other sciences are nonlife 

. , ; sciences. » 
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Results ', 

• Changes in Source of Proposals ovef Time 

Table 5 presents institutional and departmental characteristics 

_°A_P??P0.8a.ls _f or_^^^^ 



Although the absolute number of proposals changed a. good deal in the 
three years, the percentage of proposals coming from each type of 
school and each scientific area remained fairly constant over the 
three-year period. There was no evidence of'a dramatic increase or 
• decrease over time in proposals from certain types of institutions or 
scientific areas. 'This consistency in source of proposals provided 
the basis for the aggregate analyses presented in the rest of this 
report. \ " . 

Institutional Lev el « ' 

Proposals to LOCI came from institutions at all , levels— from 
major research universities, comprehensive state colleges, private 
liberal arts colleges, community colleges, and special institutions. 

* - ■ . . . 

And each level of institution submitted a substantial number of ' 
proposals. During 1976-78, universities submitted SlI proposals (or 
37.6% of all proposals).; four-year colleges submitted 736 (or 54.22 of 
the total); and two-year colleges submitted Ml proposals tor 8 .2% of 
the total) . ■ ' 

Was the number of proposals submitted by each level of 
institution consistent with the role, played by the institution in 
undergr.adi&te education? To answer, this question, we needed to know 
how; large a role, each^type of institution played in undergraduate 
education in this country. The simplest and perhaps most satisfactory 
index of institutional contribution to undergraduate education is the 



total undergraduate enrollment at the institlrtional type. We used 
data/from the National Renter for Education. Statistics (Pepin,. l97iB) 
on undergraduate enrollment at each institutional level to determine 
the number of proposals that .might be expected rfrom uniyef sit les , 



four-'year colleges, and two-year colleges. 

Table 6 compareis. the actual number of proposals submitted by each 
type of institution to the number expect^^from 'nationwide enrollment 

' ' ■ ■ . 1- ' ' ■: : .- ■ ^ 

figures. The table shows that there was a cleari relation between 
level pf institution and number of proposals subiAitted . Uriiversities 
and four-year colleges submitted more i)roposals tMn. expected; 
community colleges submitted far fewer. The numb^pr of proposals 
submitted by cammunity colleges seems in fact too l small to ignore, fn 
recent years more than one-third of all undergraduates were enrolled 
at community colleges. Yet oiily one-twelfth of alj. proposals came 
from this source. To bring the number of proposal^ received from 
various types of institutions into line with the role played by the 
institutions in und"ergraduate education, it would bi necessary to 
quadruple the number of proposals submitted by community colleges- 
going from 37 proposals per yeair to .148 per year; r 

\ In the preceding chapter, we learned that the need for 
instructional' improvement was reported to be ^greate^'^t a£ community 
colleges less at four-year colleges, and l^a^'^t universities. 
Community college, teachers also perceived^^ref'^burces of the type LOCI 
provides to be very effective. The lack of response of community 
college teachers to the LOCI program cannot therefore be. explained by 
a Lack pf need at these institutions or by a lack of faith in the ' 
sor.ts of resources LOCI can provide. * Clearly, other factors- mu^t 



O,-::. explain-, the low response from community colleges . Among the 
. ... possibilities worth considering are: less knowledge 'about and : ; 
■ fa mil iarity with NSF progra ms , less background in pr ep aring proposal 
,and le^s confidence in ability -to secure NFS funding . ■ ^ .. ' 
Institutional Control ' • ' 

V ^5.^^^,*^^ .?:'^^titutions submit well over one-third of , all LOCI 
Jp^op^ls (Tatle^7)v Xhese .institutions, however, account for 6nly' 
. . one-fifth, of ail und.ergradpa|:e fenrollinents; ^Pep^^^^^^^^ 

iAStitutd^ons therefore submit,..morr share' of LOCI proposal^ 

It is important tV:^^ and at "the ■ 

university level,, private' and public schools do not differ much in . 
likelihood of submitting proposals.,' in. four-year : CO 1^ ' 
private institutions are overrepreserited and pabUc institutions -are " 
• underrepresented in LOCI proposals /^^^ ; ^ ^^^^^^ . 
Traditional RaciM >Bar kground of the Institiitir^' - ^ - • ' 

Traditionally black institutions- of , higher" education submitted- 
proposals for LOCI funding^ in' a ch year of the. program (Table; 8) I' To. 
• determine whether th^se school^ ' submitted proposals in^^quate:: v ^ 
^ numbers, we turned bd Turner 'arid" Michael-s (1978) 'statistical . portrait 
: of thesre-iii^tutions . ;Thes.e i airthbrs reported.-th^t the'ehrpllment -in-, 
•^traditionally black institutions in 197j6 was 2U,llB;'or 1 .9 jier^nt-. 
V of -the. total enrp llment: in highe* .education in thafe' |^ar . . The^numbet 
of .propo-sals fronr traditionahy black schoola~35 ■ o^ifo' per cent^of 
. all propo'sala-rtherefore seems consistent; with; the .riSfth^ 
, institutions are . currently' playing Ih higher; educatibn^ tl^sC v ■ . 
■ country... ..' . ■ '. 
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LOCI proposals Came from all scientific f ields— froiarbiologists,- 

mathematicians, econbmis t s , jnjj^opotpBllfrr,' geo legists ; . and many 
others^;. ..Thejr-fc^ from pure and applied scientists, from .those in 
life and nonlife areas, and from scientists in "hard" and "soft" ' 
disciplines. The range of ^departmelntal ^filia£ion8,,of indiyid^ls * , ' 
applying for LOCI funds was remarkably broad. 

Did any of the fields submit more or l%ss than their share of 
LQCI proposals? Or ^did a representative grotfp of science teachers 
develop proposals for LOCI funding? To f ind out , we. had to detemine 
the proportion of college teachers in each of the fields. We ilsed' two 
sources to estimate these proportions. Our first set of estimates 
came from aj.arge representative sample of faculty, members whose names': 
and departmental affiliations we d^ey from the National Faculty ; ift, 

Directory (Gale Publishing, 1978) . A' second set of estimates came 
from NSF "report listing the number -<»f scientists and engine efs at 
institutions of -higher education iii this country (National Science 
Foundation, 1977). - • ,; ^ 

Table 9 presents a comparison- of the. number of proposals actually 
submitted from each. scientific field with, the nuinter .expected frOm the 
fie],d. .Thfe' table shows that the proposals clearly did not come, from a ^- 
representative sa^mple. of fields. The physical sciences, mathematics, 
computer sciences J arid engineering submitted a disproportionate - share ; 
the biological and social sciences and psychology submitted fewer ■— ^ , 
•proposals than expected. Table 10 "presents a comparison in terms of 
scientific areas.. The table -shows that teachers from "hard," nonlife. 
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-an3:applied- sciences subniitted more LOCI proposals than expected on 
. the basis of their representation on college faculties; science 



.■ teachers from "soft," life, and pure sciences submitted fewe«;^, ' 
""proposals than expected. . . 

Sunmary and Conclusions _ 
. Proposals for LOCI projects came to. :nSF in large numbers during 
the years^ 1976 through 1978, The Foundation received 163 proposals , 

. for. awards in. 1976, 742 proposals iil,1977; and 453 proposals in 1978. 
These proposals came from a variety'of institutions. Proposals came 
from major. research universities, state ^colleges , private liberal arts 
college^,. community colleges, and other' institu^^^^^^ _ 
traditionally black and other institutions; and from J^v^ry scientific 

■ discipline."- ■ 7 . - 

We did not study the record of other NS^ funding programs, but we, 
ao^bt that many of them could, equal the record of the LOCI progr^ in 
th^ diversity, of applicants^L The LOCI program seemed to get a . 
tesppnse from all segments of_ higher education. and from all areas of 
science. The program's broad appeal would seem to make it a valuable 
one to NSF.; Through this program, the Foundation make? contact, with 
old fri^tids in higher education— teachers at major research. ' 
universities--and. also makes, new friends at. colleges not traditionally 
involved in scieritific research. 

■ AlthQugb LOCI proposals, c'ame from. diverse sources, individuals 
submitting proposals did not fully represent^ the population of ' 
eligible collegje science teachers: • - • 
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a) Universities and four-year colleges submitted more proposals, 
than their undergraduate enrollments Tirarranted; community 
colleges submitted far fewer^han their share of proposals. 
In recent years, for example, more than one-^-third of all 
undergraduates were enrolled at community colleges. Yet only 

\ one-twelf^th of all proposals came from this source. ^ 

b) Private institutions also submitted more than their share of 
proposals, these institutions accounted for about one-fifth 

. of all undergraduate enrollments recently, but well over one- 
third o^ all proposals came from private schools. 

c) The physical sciences,, mathematics, computer sciences, and ' 
engineering submitted a disproportionate share of^ the 
proposals; the biological sciences, social sciences', and 
psychology submitted fewer proposals than e^fpected,. 

Those institutions and fields submitting mor^ than their share of 
proposals were not those with the greatest needs or fewest resources. 
Community college teachers^^ in fact reJi^ted stronger needs for 
instructional improvement and greater confidence in the effectiveness 
of resources Of the sort LOCI provides than did teachers at other 
institutionsl. The institutions and fields submitting more than their 
share of proposals rather seemed to be those with the strongest 
traditional ^ ^ixi^s to NSF. Although the LOCI program may help NSF 
extend its sefS/ic^s to a broader audience, even this program does liot ,;;, 
reach a completely representative audience of eligible college science 
teachers.. ? . . 
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CHARACTERISTICS OF INSTOTTIONS AND DEPARTMENTS 
' SUBMITTING LOCI PROPOSALS ■ : 

-BY -YEAR OF PROPOSAL , ^ 
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^ . Charaoterimo: • ^ ' I ■ : ' ' 

Control Of Institution 1 1^11 ! ^ 

I 63 38,6 I 251 I 33.8 | 190 M.g | ,\ | , / 
Level of Institution ' ■ I r ) ^ / i^^^^^^^'f [ I 

Hacial Tradition i . | ' [ [ ' 

I -158 1 96.9 I 726 I 97.8 | 139 196.9 1 
Pure V3. Applied Sciences I | ' } ' ! I • ! 

"Sled - ■ 1 l |?^rK^^rf ^^-3^^ 3.65 
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TABLE 6 



ATCTITAL NUMBERS 0,F LOG! PROPOSALS SUBMITTED 

BY THREE LEVELS OF INSTITUTION ' i 

COMPARED . TO EXPECTED NUJ4BERS 



• I 



LOCI 



Level of Institution j. Proposals 



Expectation 
Bas.ed on. Total 
Undergradua.te 
Enrollment 



University \ 



n 511 4>33^^6 .1 334 j 24.6 



.. ^TcMr-year:\^^: -t^^ 538 j ■ 39^5 

fer^"^----Tr:.;;T^^ . | ' 8,2 . j: • 486 ' 



35.8 
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TABLE 7 , * » . . 

ACTUAL NUMBERS OF LOCI. PROPOSALS SUBMITTED 
BY PUBLIC AI^D PRIVATE INSTITUTIONS '■ 
COMPARED TO EXPECTED .NUMBERS 



Control of Institution 



I 



I — 



* . ■ . .~~ f-T---- — 

I Expectatioii \. 

I Based on T^t'al - 

, LOCI : V I • Undergraduate 
Proposals. | Enrollment 



Public Institutions 
* University 

Four- Year 

Two-Year ' 
Private Institutions' 

University 

Four- rear « 

TwQ-year 



, 854 
.402 
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504 
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388 
7 





. j . 
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1059 1 


78.0 
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248 j 
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. 466 v. | . 
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TABLE 8 



ACTUAL NUMBERS OP LOCI PROPOSALS SUBMITTED BY TRADITIONALLY BLACK 
V AND OTHER INST^^^ COMPARED -TO EXPECTED NUMBERS 



. Racial Traditioiil. 



LOCI 
Proposals 



Expectation 
Efased on 
Enrollment 



N 



I 



% 



. ..Traditionally Bidck |' 35 ■ I 2.6 ' 

... ■ ■ ■ ..V ■ I . I . . 

.Other I 1323 | 97.4 



I 



■ ■■■.26.^.. 
1332 . ' 
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... , >;,TABLE 9 ■•. • 

ACTUAL NUMBERS OF LOCI PROPOSALS SUBMITTED 
BY DIFflERENT SCIENTIFIC FIELDS 
COMPARED TO EXPECTED NUMBERS 



Departmental .Field 



LOCI 
Proposals 



N 



I Expectation. 
I Based on 
'Science Faculty 

I N .1 % 



I Expectation 
I Based on .., 
I Scientists in; ,;; t, 
I Higher Ediica tio n , .; 



N 



. I 



Physical Sciences 
..Engineering. 

Mathematical Sciences 

.. ■ .1 

Computer Science . | 

I 

Environmental Sciences ,': 
Biological Sciences 
Psychology 
Social Sciences 



408 
258 
160 
23. 
45 
, t80 
. 45 
148 



32.2 
20.4 
12.6. 
1.8 
: 3. 5 
l4.2' 
3.5 
11.7 



151 
14 

49 
242 
185 
251 



210 I .16.6 

■. :■■ .■!■ ■ : ' 
165... I .13.-0 



11.9 
1.1 
3.9 
19.1 
14.6 
19.8 



.217 
127 
.99 
16 



I 

■■. I. 
. J 



■ .17.1 
V 10.0 



51 -'l . 4V0 . 
372 I; ,^9,i|. 



..147. 
238 



I 

I - 
I .< 



11.6/-: 
15.?. 
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TABLE 10 



ACTUAL NUMBERS OF LOCI PROPOSALS SUBMITTED 
. .. ' BY. DIFFERENT SCIENTIFIC AREA'S.^ 



Departme;ital 
Area 



L^OCI 



Proposals 



. Expectation 

Based on 
Science Faculty 



Expectation / 
Based dn 
I Scientists in . 
Higher Education 



N 



N 



% 



N 



Pure vs. Applied 
V Pure ^ 
/ Applied 
" Hard ^s. Soft 

Hard . . - 
Soft 

Life vs. Nonli'fe 

'I ^^^^ ' . . :; 



I I • . - 
r I 

986 I 77.8 I 1088 



281* I 22.2 ! 



:1074 I 84.8 ' 
193 I 15.2^1 



373 I 29.4 
8^4 I 70.6 



678 



'179 



831 
436 



589 I 



85.9 
14.1 

65.6 
J4.4 

53.5 
46.5 



1124 
143 

882 
385 

758 
509 



88.8 
11.2, 

69.6 
30.4 

59.8 
40.2 
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Chapter 4 / • /' 

■ LOCI -Projects . 

r-'^n the two preceding chapters we drew. conclusions about . thfe total 
populatW of coiiege; sciehtfe teachers' and about' those teachers who 
; applied for LOCI, awards. , In chapter 2- we cbncluded that most college 
science ; teachers think that science courses need improvement . Faculty 
members at.^11 types of institutions and in all scientific fields 
reported this^^ense ^q^^ 

Jf .resources.- In ; chapter V^^w^ conciluded that tfes^;. col lege scieAc^e 
.;^,eachers who turned to' .LOCI for help constituted a' special group. 
•Many ip-the groWp taught- at •universities and private liberal arts /• 
colleges;- relatively few taught at community colleges . There were.' 
iany physicists; chemists; and computer among LOCI 

applicants, and relatively few biolo&ists, psychologists; and other ■ 
social scientists. 

This chapter f'ocyj|^s on ah even more select group of college ' 
science teachers; The focus in this chapter ^is on the subset of 
apglicant^ foi: LOCI awa^s who received funding. Who are they? Do 
they fully represent the applicant pool de^|Hbed in chapter 3? What: 
sorts of projects do they undertake with LOCI funding? How large are 
the projects? l°ng in duration? What goals do project directors 

try to achieve in" these projects? How. do the project directors know - 
when they achieve these; 'gpals?^^^^^^ / 

Our specific, objectives in this chapter are to describe: 
a; the departmental, and institutional affiliations of LOCI 
prctject. directors; . * 
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b) the LOCI .projects in size, duration, type of course involved,- 

■ ' ■ ■'. ■ • >' . ■ ', ■■ ■ ' ' .. . * - ■. >• ■ 

and. content of the project; 

; c) the. outcomes expected from these LOCI projects; ' 
; d) tfie methods that LOCI project directors intended to use to 
; measure achievement of these outcomes - * 

' • ' ■ Method. .-. 

Sample ■ • " _ ; ■ . ' ■ ■ 

- A total (Xf 66 (or 40.5%) of the 163 proposals submitted in 1976 
received LOCI funding; 129 (or 17 .4%) 'of -the 742 proposals, submitted 
in 1977 received funding; and 135 (or 29.8%) of the 453 pirpposals 
submitted in 1978 received funding. We were able to obtain copies of / 
324' of the 330 proposals f^inded during this three-year period; These 
.. 324 proposals provided: the data for the analyses reported/in this/: 
chapter*^ 

Procedure V. ■ -'^ 

■ Coders read the proposals and assigned ratings on variat)les in • 
four major areas: source of proposal; nature of .project; goals. of ^ 
project; and design of project evaluation. Reliability , assessed by ' - 
calculating percent agreement in the ratings of two coders, was 
adequate for each of the four areas. 

Source. . The six variables describing source of 'the proposal were 
•the same as those used in analyses reported in chapters 2 and. 3; - 
These variables were: ^ . ^ ; - 

.a) Institutional level and control— These two variables 

indicated whether the institution receiving the. award was a 
university, or a four-'year or. two-year college and whether 
the institution was private or public (Pepin, 1978). 



■ Racial ^background of, the institution— We noted whether the 

■ ' "•' . ' ' ' ' ■' ■ ' •' ••• 

- J-'^stitution was traditionally. black or other (Turner and . 

Michael, 1978) . ' 
c) Scientific area— Three variables indicated, whether the r' " 
proposal came from the "hard" vs. "soft,"- pure vs. applied, 
; or life VS. nonlife sciences (Biglan, 1973) i ,. 
': V Nature of the project . .To descrij^e project type, we first coded 
several characteristics from the face sheet of the proposal:: ;: 

a) Funding— The three variaJJles of interest were. amount 
requested from NSF, institutional contribution to the \ 
project, and amount awarded by NSF. — ■'' '}■:' '■ 

b) ^ Duration of the project— This' variable was measured in , 
.. ' months. ^_ . . ■ .■ 

c) Class level— For this variable, proposals were coded as. 
involving introductory courses j . other courses , .9^- programs . 

d) Rank of project director—Project directors, were classified 

as instructors, assistant professors,' associatj professors, 
• ' ' 9^ professors.- \ ' ■ " - ' 

. ' ■■ ■, ■ ■ ■ ■ ' ■■ ' ' ' ■ ■ ■ " ' '■ ■ ' ■ 

In addition, we devised a taxonomy based on the content of the;, 

-instructional improvement.; pro jects . We developed the categories Vf 

the- taxonomy after studying a number of published listings of ; ; ' ■ 

instructional innovations and after sorting and resorting' the 1976 

LOCI proposals. Coders using the tkxonomy f irst cla-ssif led a prbject' 

into one: of two "basic groups, depending on whether the. primary intent 

of the . proposer was. to linprove teaching methodology or .to' revise the ' 



content of a.^cdurse or a prpgjriatf.' • Coders' then classified- the project' 
into a subcategory within the.ma'jor- category; "'For example, .p.raie<it,s ■ 
to.revise teaching methodology,^could be classified ajs: . 

a) development -of computer materials-,-smuldtit5ns, games/ 
■\. ,'. ., ^teractive;graphics progransi etc.<; ^ ' 

\ b) design of individualized systems of instruction-- Keller's • 

. Personalized System of Instruction, Postlethwait's audid- 
- \: tutorial approach, and other self-paced, mastery-oriented "f^ 
appro_aches; / : . • * ' ' 

• , c) crpnstijuction of . audidvisual materials--videotapes , . slide-tape 
' . ■ supplements,' etc. J ' ' . . ; ^ r ' 

^d) design of materials "for in^u • ^ 

i • e) revision of ^^xisting materials for disadvantaged students. 
Proposals- to revise co'ntent might focus oh: indiyidual, courses, 
programs or sequences ^.br interdisciplinary efforts. 

Expected outcomes ^^The categories used to describe project goals 
-were based on two sources. First, we examined~Wh~ sources Ja 
taxodoii)y of . higher education outcomes developed by the National Center 
for Higher Education Management Systems. (Micek, Service, , and lee^ 
1975).. The secdnd, source influencing the development of these 
categories was a reading of the/1976 proposals . This preliminary 
reading of proposals .suggested that student, faculty, arid p trier 
; out cotaes were expected from LOCI pr'ojects. Specifically, pXject V 
directors anticipated outcomes such as these:" 

>a-) . Student outcomes— -Four variables indicated whether or' not a . 

project directot expected an increase. in student achievement, 
=;a satisfaction, and enrollments, or a decrease in. dropouts . : 



■ . < . - - ■ ■ 

-b) Faculty outcomes-^^ indicated whether 

the project director expected' aX increase in faculty teaching 
- ; v ;8kill aind isatisf action .■ . 

, c) Other--These two variables indicated w^^^^^^ ^ 
• ■: : director ^p^dted the project^ to result in increased ■ ' 

community service Jand decreased instructional costsV . ;■ ' 
. Evaluation fearnfps . In additiouHo notii^l.^^ these 
:.. . ou^^ expected,.:we , noted whether the proposal described^a" ; v 

■metWvfor evaluating /achievement the outcome; ^e also recorded 

whether the evaluation design included use of a control or comparison 
^gtoup;. ''. • \ ' ; ' ' ■ . * ^ ■ • ■ - . ■ - ' 

' ■. : Results ■ : . ■ ^ ■ 

Changes in PrQ]f>cts over ^i thp . \ : » ' Vr^ . 

. . W^first looked >r possible time 'tr^^^^ ty^^ pf aoci^^w^ 
made'in 1?76,: 1977, and 1978. Our indention was to ^Lrmine whether^. ' 
•^'^^e were any changes i^: source, type/; goals, or eval^^^^ ; 
; proposals; over the years. Dramatic changes would preclude analysis' of ' 
a combined sample of prbposals from the thre^ years..'- ■ :f 

:There. were clearly differences in number and . si'ze^df the 
•proposals submitted ando funded in the three competitions.- The 
Ibsoltate number of Vp ^^^^^ J^^^ ^ ' 

first year, and the percentage ^f propbsals funded d^ , In ^ ^ 

\ projects funded after 1976 were expect e(^ J;ii -be of somewhat ' 

longer juration, and they tended to be slightly more costly . We^found"; 
no other diflejences , ho^/eyer , in, proposals funded in different i^ars. : ' 
;Pro jects from varibus years came f rom; the same types of institutions, • 
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' .' ' ■ ■ ■ ■ ■ ■ ■ ■ ,' ' ■' 

from, the same scientific fields , and from faculty members of similar 
; rank. Projects were of similar types /'had simil^t^^goalsV and used the 
' same types of designs to measure outcomes. 

• We ^concluded- therefore that projects from the three years were 

• *- y ' '■' ' . :. , . ' ' ■ . ■ ■■' 

similar enough to be included in a single analysis. Projects funded 
in the first year of the program were distinctive only in relatively • 
small ^ays . Their d||||rtion_ from the norm did not seem important 
. enough to warrant special analyses for each of the three yeai^s^ 
Source of the Projects - 

Table 11 describes the" institutional and departmental sources of 
both funded and unsuccessful; proposals. The two sets of pib^osals ' 
came from similar sources, and percentage distributions "for successful 
andunsuccessful proposals are theref orr^yery similar. Proposals from 
all types of institutions and departments had roughly the sdpe chance 
of success— about pne in four.' The review process was nol; biased. in 
favor pf : any one type of institution or any one type of scientif ib " 
field. : The institutions and fields that, submitted proposals were the 
ones, that received. LOCI funding. ' ' ' ■ " 

Nature- of the. Proieets : v - ^ „ ' 

The average LOCI project was expected to take 16 moiiths to' 

. ■ . . ♦" ■ . . ■ ■ ' ' ' ' ' ■ .■ ■ ' • ■ 

complet^.^ Although expected: project duration ranged from 2 months to 

months i few;- of the projects deviated so far frpm the average. Only 

6% , of the projects were expected t'.6 require 3 month's or less to -> 

complete^. .and ;.only .l%, were to require more than 2 years for 

completion. ; Especially common were projects of 24, months in duration 

(nearly one-third of all projects) and projects -of 12 rapijthsvi^^^^ 

duration (one-fifth of a:il projects);; ; v ; ^- ' 



-—■--^ ^Tq-compl^te-a-prdject the average\prQ ject director requested 

. approximately $18ib00 from NSF, but the.kounts requited ranged frpm 
> , $1400 to $76 /yOO. The average' 'amoun^^^^ by the Foundation was 

; $16,000;- the ran-ge of awards was. from $2700 to $25,000. The amount 
; ' requested from -NSF was only a part of the, total costs of_Jhese : 

I«:ojects, The typical proposal reportjed an institutional' contribution 
6.' of nearly $11 jbOO to the project. . ' C 

• A total if 120 of the Wed proposals (or 37 .5;^',of the -total) 

• ' • described' tVe revision of courses at thfe' intro^ductory level ; 156 
• „ ^^'^^ of th^ tod^l) focused on courses beyond the r 

. introdup^ry. level; ; the remaining "pro jects focused on_course 

^ aequeiu^s or progr:gihs . the projects ^ere expected to affect a Wrge 

^^"'be/ of sti^^^ : 

. appt^cinat^iy 1280 students would be affected bjr his <or her proj4t 
within a.periodpf;/fkve years.^ Est£mat6s:o^ numbers of students t^ be^^; 
V;, affected ranged fj;om 25 to just aver 25,000. ' 

;, • Project.^irectors for the funded pro jects c^e'frdm all academic 
;. ranks ■(Tablel2). Compared tb;; national . norms, hcj^ver, instructors 

and ^assistant professors ^ in the ranks of LOCi ? 

' "i ; P"^^''*' directors , and associate^ professors and f ul 1 prof essors j,ere 
* Further Analysis' showed that senior faculty wWe ' 

|. - overrepre^e^ted- among LOQI ayard recipients ^dt; each level of 

■ .Institution— at universities , . four-^e«\co lUges, and ^ t^^^^ . 
•colleges. ^ \ ' ; ■ ■ ■•■ '-. ' 

'7 ■/ ■ ; • ■ ' ' V. 

.- facility members ^i^ careers. Since LOCI. . ' 
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teachers who receive awards do not need to^ have, extensive 'support from 
their fellow faculty members . Nor do they need to have a history of 
funded projects behind them. Nonetheless, it is probably overly 
romantic to think of tOCI pro ject directors as Young. Turks. LOCI ..; 
awards more often go to senior faculty members than to junior ones .' 
LOCI money is less often used for a new beginning th^n for a diversipn 
from a well-worn track. 

The appeal of LOCI to senior faculty members distinguishes this 
program f^rom other programs of support for instructional development. ° 
Michigan State University researchers (Davis, Abedor, and Witt, 1976) ' 
recently reported that-applicants for educatioiial development awards . 
' made by that institution were more often younger teachers. Kozma ^ 
(1980> compared" ranks of'Vteachers who participated in four 
instructional improvement programs— Exxon Education FoundaHon's 
Impact program, NSF's LOCI program, the, national wotkshoi) program of 
Georgetown University's Center for Personalized -Instruction,'' an4 The 
University of Michigan's Instructional Development Fund program— and - 
reported that the LOCI project" directors were distinguish^ from the 
others by their' higher academic ranks . LOCI>s unique appeal to senior 
faculty'metaWs may\be a strength of the program 

Nearly 60% of all LOCI. pro|ects were directedifcoward revising ' 
tea'ching methodolpgy, and about 40% toward updating or adding, new 
content (Table 13) . About One-third of the methodology projects used . 
the computer to individualize teaching, and mariy ./other iJrojects sought 
to individualize instruction without ^the computer; e.g. ^ with Kellfer's 
'Personalized System of Instruction or Postlethwait''s audiotutorial 
approach. Another large group of projects sought to improve teaching 



• by use of in^iu^ry learning; e.g ■ , case materials; Wales' guided design 
. approach, .or open-ended laboratory investigations. Over twb-thirds of 
the^ content^oriented p^^^^ fo4sed on a single cours^. The other -' 
content-oriented projects were directed toward a sequence of courses 
or were interdisciplinary projects. ,t . ." ' , ''^ 

Project Goalfl ^ 

Pr9je:ct directors expected a variety of outcomes Jrom their " • ' 
projects. (Table 14) . Over three-quarters expected an increase in ' ■ 
student knowledge and nearly three-quarter^ expected" an increase in ' 
student satisfaction in courses revised with LOCI funding. Other ' 
outcomes mentioned by project directors were increased,. faculty 
satisfaction in teaching , greater cost ef f ect iyeness, and. Increased 
enrollment. Many of the project directors ant>icipated achieving " , 
success on more than one of these goals. ' ' ■ . 

Evaluation Desig n " 

V The evaluation (Resigns, proposed for measuring these outcomes were 
hot very rigorous (Table ;4). One-third, of those who expected an .\ 
increase .in student^ achievement, for: example-, did not propose to 
measu^^ student, achievement in the; course revised Vith l^OCI funding. ^ 
Another third proposed to measure student>chiev.ement ia^the course 
revised with LOCI funding but . did nojt plan to^ collect achievement data : 
from.a control^or comparison group. Only one-third of thos\ 
interested in student achievement inlended to use both a treatment and 
control group in th^ir evaluations, j^. . . : ' 

; . .For other outcomes , lack c^f rigor in . evaluation was equally • 
notable. A total of 225 of the,324 project directors (or 69.4%), for 
example, expected student satiltaction to inbrease in their, revised 



^ .1 



^.courses. Although most of these 225 proj'ect directors intendect to 
measure Student satisfaction in a revised CiiJ'ursei only 42 or the 225 
intended to, coinpare the responses of the students in. th^Wevised ^ 
.Miirse with responses of control students in a previously o? V 
concurrently offered course. } ^ ^; 

The lack of adequate evaluation plans for LOci- project 
of thfe 'key impressions that the 324 proposals made on" us. Some o^ the 
proposals seemed preoccupied with the means that -would be used in a 
project— configurations df hardware, and iayouts of .space.--and seemed 
almost to ignore \^e ends to be achievei%^^ 

those project directors who were exllicit. about their objectives werfe 
often vague about fiow they would deJonstlate their >chieveHient of 
^hese Ob j ectives . Only a few proposals among ; the 3 24 tH^t w€ read 
contained names of tests and Instruments that would be used to 
demonstrate eff'ects. And at most only one or two propbsafs^ >^ 
data, on the Current level of , achievement or student satisfaction in'* ' 
the course that might be ref ined., with LOCI fd^^^^ 

" ' ■ ' '. '.. ' ' ' . * ■■.»■.■■■.* 

- ; ■' y 

; Analyses reported in this chapter Sh^jyed that review o|!^iC)C I ; j 
proposals by NSF . review panels waS evenhanded .. Proposals from all 
types of institutions and'-.scientific fields had about the same chance 
of ^uccess-^-about one in five. Institutions and fields that submitted 
many proposals received many LOCI awards; institutions and fields that 
submitted'few, proposals received few awards. , 

The statistically average proje^. supported by a. LOCI award 
required about $16 ,000 of JT^ funds .'about $11 ,^ . 
and about 16 months fpr ^completion. The project was about as jhsip ^ 

■ ■ 52'- ^y^^^^^ .0 



; ^to involve- an introductory iourse as "if. was to. invoive an upper. 
■ division science course. The typical project was expected; to affect' 

■ apprpximately 1300: students. during a five-year /period V : - 

V , . LOCI project , directors came from all academic, ranks ;. they . . 

• -included instructors, assistant professors, associate professors, and 

; v-^,^fu;il professors. ^^i^^^^^^^^^ - . 

somewhat, overr^present^d and instructors and'assistant prof essors ■ " ■ 
; somewhat ^underr^teseiited^^^ ^^w^rds, ' Programs like 

. . LOCI :that offer support for instructional improve^nt-:rbbth, " 
:, mounted by individual institutions and those developed for ri^tional ; / 
' audiences-have often been;report^ed to be more attractive to junib^ ^ 
faculty: than to senior ^faculty . ^he kp^l. <,f LOCI to senior faculty 
members distinguishes it^ from' other -^rogrkms ' and may be a unique 
. sfrength of this funding program. . J-;. 

: Nearij^ : &0% of all 1.001 prbjects were direqt^d tbwardVx Wising 

■ teaching methodology, and about 40% toward upd2^iig or adding new 

• content . About.; one^tlii methodology- pro jects ;were cbmput^- 
-■ based; many of t^e/other; methodology j>rJ^fects involved indi^^^^^ 

• instruction or inquiry' learning. The outcomes most often expecMfc 
from LOCI projects yere increased student knowledge ^ of more\ 
tn^ir 3/4. of all projects) and increased student satisfaction (expected 

... by nearly^3Mo| the projects). Other outcomes- mentioned by pro jefit. 
directors in: th^^r proposals were increasec^Vaculty satisfaction in ^, : 
t^9|hing, greater cost -effectiveness/ and increa^^^ ' 

• ; One of^the most striking impressions left f roJ;^bur-4eading of 324 ' 
funded ptopdsals^itas of the weakness in;designs u^fe4 to^^miuate. '■''''^}4 

.project outcomes. 6ne-thi::d,-bf those who expected^hMiiSase in :;' : 
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<^ student aclii^y^^^ for' example, did not propose aajfT^ - 

b^asuf ement of s'tu^ea^ achievement^- course revised with LOCI 
fuitding^.. Another thi?rd proposed to measure .student achieveinent atf '^^^^^^^ 
.reviW course but did not plan to collect achievement data from a 
contr^i coutse of ;any sort. Only one-third of those interested in , . 
student achievemeixt;' intended to use both a t>i4atment^^ to^^ control group 
in evaluating project outcomes. \ " . '1? 

The statistical portrait of LOCI projects presented in this 
/chapter holds equally well for projects funded- in .1976, 1977, .and 
1978. Projects for three years came from the same types of 
institutions, from, the same scientific field^,. and from, faculty ' 
members of similar rank; >.Pxojects ;f unded d^^^ the three dif ferent i r 
- years were of similar types, had similar igoaU^^^ :empioyea the same"' 
types of designs for measurement of outcomes. 
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,. TABLE 1,1 



::• v.. 



CHARACTERISTICS. OF INSTITUTIONS AND DEPARTMENTS 
. - SOBMITTING SUCCESSFUL AfJD UNSUCCESSFUL^ 
LOCI -PROPOSALS 



Characterist'ic 



' . Successful ■ 1^ 
I Proposals; | 



Unsuccessful | 
Proposals I 



N 



Chi- . I 
Square | Sig. 



Control of Institution 
Public ■ 
'Private 

Level of Institution 
University 
Four-Year > . ■ 
Two- Year 

Racial Tt-^adition 
. Traditionally Black 
... Other 

Pure vs. Applied Sciences 
Pure ; . ■ - 

• Applied.. V 

Hard vs.. Soft Sciences 
Hard 
Soft 

Life vs. Noniife Sciences 
Life 
Noniife 



199 I 60.3 I 
131 I 39.7 I 



128 
173 
29 



38.8 "I 
52.11 I 

.8.8^ I 



8 I i 2.11 j 
322 I 97.6 J' 



..fi'v^--' 



255 

78y 



76.11 I 
23.6 I 



282-^' 
il8 



+- 85 .5 I 



92 I 

238 I 

I 
I 



lit. 5 



27.9 
72. 1 



655 
373 



63.7 
36.3 



383 I .37.3 
563 I .^511.8 I 
82 I 8.0 I 



27 

-1001. 



2.6 
97.11 



.734 1- 78.3 I- 

203 .1 .21.7 r 



792: 

I'tS 



a8i 

656 



811.5 
15.5, 



30.0 
70 .0 



1.25 



■0.61 



O.Oil 



0.55- 



0.16 



it-:) 



0.52 



ns 



ns , 



ns 



ns 



ns 



ns 
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TABLE 12 



ACTUAL ^ NUMBERS OF LOCI PROJECT DIRECTORS AT FOUR ACADEMIC RANKS 
COMPARED TO EXPECTED NUMBERS - 



■ft 



I' Expectation 



I. 

I ■ 



- ^^ Project } Based on : | , 

Acadeiai| Rank ; | Directors { Population J Chi- [, Sig. 



■v? '-'i ' — -rr-r-?---*--^- — 1 Square.- 
i N f % I , N. , \ % I ^ 



Instructed. ; " I 9 I 2,9 { .35 l' 11.3 j 22.02 I .001 



I 



Assistant' .Professor | 9Z: I 29.7 1 101 | 32.5 | ■ 
Associate Professor I 87 | 28.1 j - 88 I 28.4 | 

Professor - ; ;| r22 \ . 39..it. |: . ^ 86 | :27 .8 jf a ! ' 
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TABLE 13 



CLASSIFICATION of' 324 LOCf PROJECTS 
BY CONTENT OF PROJECT 





--• — ■ — .- — — 


■N , 


1 ? . : 




1 


65 


1 

-1 , ■ ■ 

. 1 20.1 

I 


45- 


1 13.8 

"■.,1 ■ ■ . . 


. 51 


1: 15.7 

■ 1 :• 


22 


1 6.8 

■1 ■ ■. 




■ 1 2.8 

.1 


74 


1 
1 

• 1' 22.8 


38 


1 11.7 


20 


1 6.2 



' Type Of Project 

• Revision of /Teac^iing Method. 

Cdmputer-hased * , 

; Individualized instruction 

' inyiiry learning 
:. Audiovisual materlais. ■ 

disatdvahtaged 
Revision of Cbntbht 
; New; or 'updated, course ; 

New or updated programs ■ 
. ;^?^:^^"terdiscipiinary course. 
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TABLE. in * ^ 



EXPECTED OUTCOMES AND METHODS OF MEASURING 
IN 321» LOCI PROJECTS 



I Proposed . 
I as Project 
Possible Outcome | Outcome 



Proposed 
and to be 
Measured. 



I Proposed 
I and to be 
I Measured 
i with Control 



Student Outcomes 
Knowledge 



K Satisf actio 

■. •■ ■■■■V- ■ : 

/Enrollment 
. Retention 
Faculty Outcomes 
. Teaching skill 

Satisfaction 
Other Outcomes 

Community 

EcpnpmiQ 



N , 


1 ? -1 


. N 


! % I 


N 1 


p 


2611 


1 1 
1 

.1 1 
1 81.5 1 

1 . 1 


176 . 


1 1 
1 

.1 1 
.1 511.3 I 


1 
1 
1 

911 1 


29 ;0 


225 


1 69.ll ,' 
1 1 


188 


1 1 
1 58.0. 1 


I" 

112 1 


1.3.0 


69 


1 21.3 1 

1 1 


111 


1 1 
! 12:7"! 


1 

. -11. 1 


3.4 


19 


! 5.9 .' 

1- P 


13 


1. , 1^ 

1 n-o j 

1 1 


1 

8 . 1 
1 


2.5 


22 


1 . 1 
1 

! 6.8 ,' 

1 1 


.'■ 5 ■ 


1 

1 1 
1 ■ 1.5 1 


. 1 

1 
1 

0 j 


0.0 


78 


1 211.1 1 

1 1 
.' . 1 


56. 


1 1 
1 17.2 1 

j 1 
I - 1 


1 

5 1 

: 1 


1.5 


37 


1 . 1 
,' 11.11 j 

1 • . 1 




1 .: .1 
1 1.5 I 


■ ■ 1. 
1 

Q r 


o.p 


73 


1 22.5 .' 


25" 


1 , 1 ■ 
\ 7.7 1 


■ ■ : ■ 1 ■ 

2 \ 


0 i 6 
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Chapter 5- ■■ ',. '! ; ■ 

'Outcomes Reported by LOCt Project: Directors i^ .. ;. • ' 

What A^ere. the outcomes of the -LOCI projects? Did the' fatuity ^' 
members who^carrie^ out these projects consider them successful? Did 
the projects contribute as much as expected to student learning and 
satisfaction? . Did they contribute to the development of tlie^^p^^^^ 
iirectors as science teachers? Did they'have j.>ipple" if fects on " 
>ther faculty members at project directors^ InStitutions'^or othet 
Institutions? ■ .:.yf:s' 

This chapter and the chapter to f bUow provide^apswers/ tc^^he^^ 
luestions. In this chapter we present results: from^ questionnaire on 
.OCI .Oi/tcomes mailed, to project directors and t<^i chairpersorij" or^^^ 
^the project directors' institutions. In the, chapter to follow,' w 
upplement results from this survey with^a^^^^ 

utcomes that project directors document^d^Mtheir f^nal pri) j 

eports, ■. . ■■ " : : ' , ^ - 

Method ■■.■ /■ ■ .•„._„;■■■. ■:}.,'.: ;'■ 

lestionhaire \ '■ ■^';r>':f ■ 

We developfed two forms of a questionnaire for evaluation of 
itcbmes of LOCI projpts: Onefof the forms was d;signed to be: filled 
.t by. project directors; the other 1iy department.^c|ial^^ 
tstitutioiis; receiving LOCI awards- (Appendix B) . :^ knd : 

rdirig on the tvo forms of the questionnaire differed slightlyi but 
, subst.ahce the two forms w6re identical . ': 
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; Each :bf. the. foms 'had four major parts. The first- consist 
four: items asking for an,.overall evaluation of the success of the 
''^project. The second part had eight items on. instructional outcomes oi 
I the. project. . The third part of the (questionnaire contained four 

items, and covered effect of the project on the faculty member. 
^ FinallyV .the twd^items .in tlffe fourth part of the questionnaire asked ^ 
, ;f or a' desqript ion q'f ' the . curr eiit ; s ta tus of the • pro j ect . 
^ . . The items used- in the. questionnaiire were. siiniX^^ items used by 

• °?p'!^5,'f;'?v?^^^"^*^^°^ and, faculty development programs: 

a): The four items on overall evaluation were also used in the 
evaluation of Michigan State's Educational. Devei 
. ■ ; I'rogran' (Davis , A^edor^ and .WittV i976|iv::.T^^^^ makes - 

about 3f awards a year . tp Mi 
..\ .->. instructional improvement -pro jects. . The dollar amoudt' ofi 

awards at .Michigati State has' varied over the yeaEsv^^^^^ 
typical ^ward averaged $10^000 in. 1965 and about $2750 in 

h) . Items on instructional outcomes, faculty development, and 
<^^rent -/Status of the pro ject were' similar . to^ those used in 
eyaluating the Calif brniia Statfe tlniv^rsity and CblOleges' 
^^og^a^ for. Innovatipn anddmprovement: in the Ins tructibnal 
V . Prociess (Calif ornia State Universitj^^d Colleges,' 1977): ' 

During the first six yea^rs; of its existence 
_ made about 150 awards per year tp'California State teachers , 
■J.y\.,-':'/'-^ 'for/instructional improvement projects. Funding for this 
program was recent iy augmented,' and the .maximum amount of. 
/ awards was raised to . $5000 /in 1977--7 8, ^ . . . . v 



i V ' ■ ' ■ ' ■ ■■ ■ " • * ' ■ ' ••• • 

' ~~——^,^-,.j^-.--^^---fr^-—-^-^ — ^v-j- 



■ ■ ■ . ■ .'^"y °^ .i.'^^'^s on . were alsc. used in a • 

'■, ■ telephone survey -of 'indiyi^l|^ ^ in the Exxon 

:'; . Education Foundation's .l^pkt, Universitj^^p^ 

. Michigan's Instructibna,!. Dev^I6piiient :'f^^^ 

national, workshop program of. (&6,rgteVov^ University's Center ^ .• 
for Personalized Iristrutti . /. v 

. .Our;^ecisi^ previousl^is^^ deliberate; / 

• the use of these conunon items allowed; u^ to' compari reported LjQ^ ' ^ ; " ■ 

.■.outcomes with reported;putcomefe^f ptl^ . ■ ' >• 

. ■ development ..programs . ■ ' • ' \ • j' "; . ■ ■. '■ r- ■ ■■' ■ ' ' ' 

/ Sample ' .; V r-^' ■ ' '.^ V' h ■ ' . ■ '•■ ' ■ ■ ■ - '-^ ^'^^ 

•; In April of. ~1 97 9 we mailed two questionnaires—one; f^ir^Vroject • -"^ ^ 
director and; oii^ for department c^irpitSon or ^^a^ 
; prc»ject directors^ who had received LQqt^aWrds in 1 9?^^ •;: 

■januaryof';197^;; Twb::..w^ a^^ feetitf; ie^oS^^^^ 

copies of the questionnaires, to ndnrespondentS* By July 1979 ye had 
received completed questi^^^^ 

from 32 departmental chairpersons. ' V ■ i^^" 

deans whc) 'liad not re^rned, questionnaii^es .^^^^^ 1979, ^ - ; 

however , .we _ telephone^ th^ ll directors who had not returned . / . ■ > ^ 

questionnaires to^ cii?c;k . on: their ^addresses- and to ■ ask :bitfcagain:r fc' 
cooperation: in our study. OVfter . contacting the project directors 'by 
phone, inj^ securing their cooperation, we mailed addiliidnal^copies^ ^^^ 



£^:^^'^::'''-^'-;.^'::..: v^':' 
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' tlie. que^irion^^ to theim in November ' 1979^ ^ We Teceived^^x:o^leted '-^^\ 
; ;\' .quegtipttriiires 'from foiix of-ti^-i^CI ■pT0.2ectyi^^ctots for a tota,!. • 
^^;,return'^r^tt,e of 59 out- b:^.,|^;^|PpT '89.,4%) . ■ '^f^^' ' . ' ■ ' 

Cfiaracteristics of PfQife^ts * aw v '-^^ /.^/M ''V 

•/ A number of characteristics of pro ject: directors- coded for 'f^'- 

•./.■V-/ ; ' 

previous analyses wete/ayaii^ble for this aii^^ inc;lpded:' 
. .a; ' Institutional characteristics-^-Institutions 
/ ' V^^^^ : according -tovlevel a^^ _ ;v 

• ^^^^s—PrbjejCt d^ clisHf ij^d^^i^^ being • ' 

^^^^ "hard" or "soft", sciences, ' 

•- and' life pt'jioh 1^73). 

Individual character i^t^^ of project dir':^cC6rs-rrTtie' t^^ 
characteristics coded were acavleiaic raiik; chai^persbnv^tatus , - : 
■ _ and'-'aidiainistrator . status'.."; ••'A ' . 

Respondents " vs ., Nonres^6bdents' ^^^^ ; - ' ; A 
.. ^- number ^vof. nanresponidents to - the outcome ^ 

questipnna:it:e, we; knew that it would be difficult to find any v 1\ : ; 

statistically significant differences between resjpondents and ^ ^ 
: nonrespondents, but it important ^to compare: ■ . ' 

* ;;^;tlie two grpu^^ whether, project directors who. returned ' 

questionnaires differed substantially from those who did not rq.turn ■; 
queistionnaires. It turned out rthat respondents -and npnrespond^^^^ 
were veryj-^similar in-m characteristics (Table 15) . We could see;- 
no reason for believing that, individuals, returning :q^ 
:%^f.ered in" institutionaiv departmental, or itidividual characteristics 
from individuals, who d\id not return questionnaires. • • 
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In^ this sectipn we. preseflt Results on ;^^t^^^ 
the quest ionn^ total group of i|spohdents-. ^ \ 4 

0^^eral4-.evaluat^on . Most projeict direitors reported that ti^r 
projept^ were successful. (Table.|6). Ap^rox^niately "93% of 'the project, 
■ *^i^e^tors said that their pro jects were ^prob^ibly or definitely a ; ' 
• •^""^^^■i '-^^i^^lW^krsaid that0,p^je6t AeTe%om thi 
effort; app^i^ 

considered th^it% . 
Pgi^ect directors were veryfaiii lar to those ^ide: by : thf JireS 
. e4cational' develbpment .^rjigd^s ;vsu|,por ted Mictligan ^M^^^ 

;|ichigan.Stat^ pro j dirWtJors Ic^ons^lSr^d 

: :def iriitely a success; 95% considered th^ir pirbj the efJb^li- 



94% would ^coi^ider another: educ^ project; W about ^ 

79% reiJartedjhat their colleagues considered : these projects a • B 
.■"success.. '. . ■ ■ . ■ '-"d/ ■ ' 

- . .: ■ ■ The -secoflljl^part of Table 16 shows /tti^i,||pi£pS^|;Si 
were very similar to those of project dlr^^s,..^^pproximately: W of 
project directc^r s , ^for ex considered &.0^jects a success ? ' 

;and approximately 97% of dep^^tient . chairpersqri considered itiese ' — 
projects . successful . Apprbximatejy^.95% of project dir^tojs and 97% ' ' 
of chairperson8.^rate;d the projects-as probably;or def^^^^ 
effort . Siiilikfity in response of project-directors an#departmentaL. ; ■ 
chairpersons was not restricted to ^this. part of the questionnaire . It ' 



\ 
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. I^vas notable, in results on every item that we asked. Similarity in 
Response of pro ject directors and chairpersons is one of. the salient 
features of .the tableis which fallows in. this report. , ;.; 

V j^:V: in8tructiotial effect^ THp fypiv^r^ j^^V reportediy . 

affected. 150 students each- year , and most project direcito^ 
that the eff ects on students/were very positive (Table 17) / ^Benefits 
. on ^- learning an& cburse.^^e were reportedr to be eapecially cle^ 

App:rd:fimately.;88%; Of all project airectors reported at least a slight . 
increaae in . th^ member: of students learning course material',' and 98%. ' 
reported some increase :in student satisfaction. The increase in •, 
service to the .' community ^.w^^^^^^^ slightly less dramatic;" about 67% of 

. project ^directors .reported/ ^ service ; . ; 

attyibiit^ble to "their .projects . LOCI pro ject s apparently made smaller ; 
cohtributions to -course enrollments,; dropout rates, .and instructional' , 
^°"^* than half the project;; direct ork^ 

^roUmeiits or decreases, in dropouts -.due to LOCI projects and about a 
third of ^e,;prbjects:;reportedly reduced instructional '.c^^ 

■ Our ItSems on student learning and enjpymient were siiiilar to items 
used by. researchers at tfie California State- University'and Colleges in 
their eva'^^iit^ion: of . . the Program for Innovation and -Imtxrovement . in the 
Instruction^ Process (California State University a^^^^^^ .. 
1977) . ■ About 96% of Calif ornia State award jreci^ients; reported . 
\the number, of students lellining course, material iylcreased at least -K::^'-^'-^ 
^lightly, rand all of the award recipients in the Califbrnia State 
. competition reiiorted that students, "enjoyed the revised courses more 
.>;.^th|in they -had the original cour?e3^ These _4esults are, of, course, 
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■ ^°^^'^Y ^^v^^°Pi°f"^ ' Most praject. directors reported that their 
., pioaectsJiad;a favo^^^^ their professional development 

VXTable 18) ; said that' their general ef^tiveness as 

•teajqhers improved; 82% r^orted an Vincrease in professional . ^ - 
; satisfactioh; 6.5^^3?eported increased involvement in teaching ' 
improvement; 56% reported more contact with other faculty . abdut 
teaching improvement;. Responses of LOCI project diredtors to these , , 
faculty developmerit items were, very similar .^ to the responses made by . ■ 
_ California State award recipients to a similar set of ifc&ns . A total 
• of .79%; of the CaUfornia State award Recipients repotted increased j 
. Effectiveness; as teachers; ^H repbrted i^^ .. -' - 'M^f^^ - 

v^tisf^ction.;..^^ 

: on .campus; and 50%. rep^ 

V; ■ C urrent status of the -project . ;.A total of 58 pro ject ^iireitorS 
^ resp^jnd^d to orur questic^ of their 

^liOCl projeqtl^s;:^^^ tl^ir|i>r6l|cts ■ • . ^ 

;^ould l)e■^onti^u6d^,in a;n: e3q)afeaed f ormJV26 ^.(or 45%) Jepdirted; rt^t y.' 
the-ir pto^^cts woulci ;be conti^hued in tfe original for^j)^ 13^^ 

reported that, their pro jects would be cdntinued iwith -reduced scope : 

aiid Mor 7^) reported jhat t^ir^^^ 
.Researchers atythe'^Ca)lfp^ State University and Colleges used a " 
■is|pi^at it^m.- the, system's, instjiur^'ipnal 

ifliprovement program^ ' ^ Calif ornia^ State pro ject directors reported a ■ ' 
'^^^^yle^s favor a}Ile iat^f 6t their pro jects. than LOCI . pro ject 

d^ctorsUid. In the California State system; 32% of i;t)ro ject ' . 

dii|ptors xepoi^ted con|i^^ j^^^. 



lfl% reported continuation in the oirigiiiai; form; 43%. reported ^ 

/ ■ ■ ' . / ^ :;.•;>•. •' , ' ■ : . • ^Z;'- • v / ; :a ••■ ''th^ ' 

reduction in project scop6.; and 4% reported! ^cancellation theix : " 

■■.^•>pto-j(Bct8,"/ i-.,. ;• " ■■ • 

Of the 58 project-^^ who responded to our- quest iW^^^ use 

^^of . their LOCI projects'' by others , 33 (or '57%) reported use by other 
.ii^structars in their own departments, 12; (or 21%) repbrted lise bjr 
instructors in other departmentsf and 20 (oi; ^34%) reported use at^ 
other institutions J /. A^\:pmparable item .was lis^d: inj|^ 
Stat eveValurat ion of its instructional improvement program. = Project 
directors in the California State system reported slightly less use of 
their results locally /but the same .amount of dissemination of. results 
:^*:?y°*^^^^^®P^^^ amlnin^titution^ JState system, 

• S^^^ tiaachers in thei/r ; 

departmenrt|,:' Zilyreptort^^ and; 29% reported 

•v:\x8-e at;'-,6tfi4r vinstitutionS. ^ 'yl, . 

Differences among Institutions. Fields . and Individuals ' v-'^-j^' 
-i I? this part Of. the analysis, we* tried to determine whether LOCI 
^projects had different^ outcomes at different types of instij^titions;, in. 
different^ fields, .and f or;:individuals in dif f^^ent?; pbsitibns -■:':] '■]■ 
evaluation , The ■ four items on o^^ral^^ 
correlated highly with each other, 
df a fa&t^^^^ af the four items, we decided to calculate total 

vscore^- tq,jr^ / 
reliability: or ^.t^^ 4-item scale was *78. We used\ ; 
regression; jto eitplore the relationship between .scores on this scale 
■ and inst itut ibnai >and departmental charact ef is tics o^ respondents No 



eyaliiration. of • 

■ . ■ c .- •.■ 

flTsing the'; results 



institutionai, departmental,,«r individual characteristic was/ 
, . significantly related, to oyerair evaluati'on.pf succesis of LdCI / . 

■ pro^cts. ■ ■ • ' ' ■ ; .■: ■ ■■ 

> .. ^"Stru^t^onal effectivpnpss .; We; first . det^ 
■ number of students affected.by lOCi projects was unrelated ^to aiiy ' 
; • instittttional,. departmental, or individual characteristics. / We then . 
;,used -factor analysis, to expldse the .dimensionality of the 'eight items 
^ on^^instructional- ef feet ijren ess. We, agaiiiv found one cbimon factor; in 

■ the eight items, and formed a scale to measure overall . instruct iona.l 

• . effectiveness by summing s cores on six of the eight items, . Two. items 
; w«re ^excluded from the^^scale :becaus€ of low communalities an4 low 

loadings <jii tias. c^ two items were: . stucf^rits V 

: learn^vsomethingcdiffei:^^^ instructional; costs decreased, The ^ 
;.■ alpha-reliability for this scale was^68, ' in a f inar ' 

vfound that; -^epart^ 
• , were 'iiot-^^ scores on the instructional, effectiyeness scale. 

--^^S^^ factor Salysis as a basis, we 



development by. summing/ v ' 

,y scale was pip We found faculty d^^eiopmerit outcomes were not .^■ 

W related e^rinstitutionai:^ 

j>"^rent status of t:he proi pcf. Our questionnaire mej,^§:ed : , 
) 95 >OCI projects in tvjc^'items . These itemtasked . ' - , 

■ . whether the project was being contiiied in"some- f orm op^ 

discontinued, anii whether ^.t.he. product of the LOCI project was being •( 



•■■■'V- • . •-•-r.l ■ • '■ .... ' "■ 



used, by others. We found na re iafcion between i^^^ ^^""^^ .v/!. 

departmental, arid individual characteristics^ and the current status of 
. the praject as mea^^ .. . 

• . ; ^ - v"" Summary and Conclusions * . 

l/;/"' : Ih ApriL-of^^^^ senli questionria:irei, to^^ 6^ ^ ' • 

^ -directors scheiu,l$d;^t(^^^^ projects;by:^ end 197^^ v " ' 

A total of 5a of these 66 -ptbje^^^ 
Vus. These 59 respondents 'represented ;the ;t in- 

terms of individual charact eristics *and- in«titutl<mal / and depart^^ntaF^^^^^^^ 

" ', ' ' ' ■ ■ ''V:' " . ■ ' . ■ . ■ •■ ■ " ' ' ' • r '\ ' ' . . ■ ! v ■ •" . ' 

affiliations... ' ■^/y: ^-^ ■ • ■ 

Mo3t project directors considered their projects t^^ 
successes . they also jreportetLcrle^af benef its '^fai students 6 
the teachrng ef f igctiyeii^Bs items>,^ jadditiori^f^p:i3t: ;prd^^ 
^also reported thatjM^ projects contributed ^to thei^ prof^^^^^^ . 
1 developments When asked aboutvthe current status of , thexr. pro j.ects^^^'' V:^^^^^ 
majority of project directors^ (71%) reported thaf^ their pro jeoj^^bal^ 
-be continued either in o^riginal. or expaiided 

that the p^pdupts of their LOCt work w^re being used by others either 
within or outride their, .institutions. . . ,^ ■ ' ' ' 

Using f actor ana^ly;s;is as a guide , we ^constructed^ three scales to 
measure: project directors' projects, -'''Slsf:^., 

contribution of the project to 'ihstructionar ' r : - > . ^^i^ 

cobtributipn tp f acuity development The .aipha-reiiabilities for^- 
these three scales were .^7, .68, andV.71 • . We were not a 

any relationship between scores on th'es^e scales- and chaxdct eristics of ' 
LOCI project directors: or characteristics of the institutions and ' 
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departments in which^ LOCI .ppjecti:^^|a^d: p 

to; fiQd a relationship b^iween in^stirt^^onal, de^^ . ' 

individual characteristics and ; th^,;|u?rent 's^t^^^^ of LOCI pro jiqts;^ ' 
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TABLE :i 5 



CHARACTERISTICS OF RESPONDENTS AND NONRESPONDENTS 
";. • ••••^ v;' TO THE OUTCOME ..QUESTIONNAIRE . . . ' 



Characteristic 



Respondents 



i Non- 
I .respondent is 



'^N I. ?v 



Control of Ijistitution 
Public .; 

Private..:,, ' ' ■' 

Level of Institution 
University^ _ .: 
Four-Year- ' '■ 
Two- Year ^ 



•33 
26 

23 
31 

5. 



55.9 
44.1 



39.0 
52.. 5' 
a. 5^ 



3 
0 



71.4 

2.8; 6 



42.8 
.57.2 
0.6 



Pure vs. Applied Sciences 
Pure 
Applied 

, Hard vs. 
. Hard. 
Soft 



i; Sciences 



Life vs. Nonlife- Sciences 

0-^ Liife. -^' - 

V Nonlife .■".-^■^ ' - ■ 

.Academic- Ranks" '■ ■ 

... Assistant Professor 

Associate Professor 

Fiill Professor 



45 
14- 



16 

43 



17 
13 
29 



76.3 
23.7 



5,1 I . 86.4 
8/4 •^13.6 



I §7.1 

I 7^.9 

I ^ 

I 28.8 

I 22.0 

I 49'.2 



5 
2 



6 
i 



? 
2 
2 



71.4 
28.6 



85:7 
14. '3 



If-' 1. I. f .. 14; 3 '■'■.^ 
! 6 ■ I- ;85.7 



33.3 
33.3^ 
■33.3 ■ 



■a';., 



. * .■-uiij.—., ■ 
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• ■ ?: .,. TABLE' 16,. ^- r^iy-' ^'-^'-Aii^^^^^ 

OVERALL.EVALUATION OF LOCI 'oUTCOMES BY 59 PROJECT DIRECTORS 
MD 32:DE>ARTMENlV.CHAIRPERi0I^3;^^^^^^^^ 



Item 



I ..Not |. Not lOncertairii Yes | -Yes ' 

■ (1) ;;. I (2> I • (3)^.?| (i,) -J. . (5) • iMe-- 




.-'PI?0^^^^^ DIRECTORS \ 



■ '^Project a 



0.d\| 0 I 0..0pi^ 6.^^^ 

!-'a.|;o,0:|,o:p^ 



Project a Success 
; Worth the Effort 



I p. 1 0.0 j o j 0.0! 1 j;3.r m !^.8| 17 1 53.1 I ii. 50: 

0.1 0.J pi I 3.11;^ i (^.o i g '28.1]^ 



s 
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rABLE 17 



EVALUATION OF INSTRUCTIONAL EFFECTIVENESS BY 59 PROJECT 
. , / \ AND 32 DEPARTMENT CHAIRPERSONS ^ 



DIRECTOKS. ' 




Item 



■ Hot^at All, I Slightly, ,] Considerably I 

I N .1 ? r N -I.J I: N, I ■$ 



. To a 
•Great Extent I 



I 
I 



I Mean 



"N 



Mor^ Learning 

More Retention ' ;,. 

'More Enjopenfj^ . ' 

Blffereait Learning 
Increased "Enrolinient 
.Decreased .Dropouts 
More Coinmurilty Service 
Costs Decreased 



1 



PROJECT DIRECTORS 



I 12.2 ^1 15 r30;6 I Ul 



^^----T-jj&rr*- 



2 

26: 
25 
17 
33 



6 

^.1 .8.7 
1 1 . 2.0 
I; 3.8 
I 57.8 
I 56.8 
132.7 
.63.5 



19 
8 

7 
11 

13 



I ^1.3 J ;i? 
' 16.0 i; 25 

Ma; 5 -I . fa 

I 2il.i| I 6 
r 29.5 




6 

I 22 | l)2.3 I - , § 
12-1 23.1 -I ; '5- I 



I'^'e^?^:; 1.2.50 
l'5^.0i: 1,3.12 
J ; 63;5 1 3.il2 

0.0 : 1^.117- 



■ ■ ' V ■ ^EP^RMT MiRPERSdNS , 

. 73:'|:if,i:;|j9 ,453;3:,l 



More Learning 
;Mo<«e Retention : 
More Enjoyment .;V 
Different -Learning,. ^ 
Increased Enrollment' 
Pecreased Droffouts 
More Commuriity Service 
Costs Decreased ' . . , , } ■ 



I 

I 

I 
I 

I 

A 



. 1 

2 

■:-2'- 

13 
i3 

7. 
21 



I 



I 



3.6 

ft6.5': 
r^8,i 

I il6.i| ; 
I:'2i|.1 
I, 70.0 



2 
3 
,7 
13 
10 



i 32.1 I 



I 



I :7 I 



6.7 
9.7 
25.9 
MA 
34i5 
13.3 



16 

-8.' 
il 

1 

. 3.': ■ 



33.3 

50 it). 

53.5 
25.8 

ir.8 

3,6, 
31.0- 
10.0 



22.6,;.S^67^^^ 




I ^iia-^- 
ss'.i: 13^35^. 

11^1" '1; 1.8^ 

l6''3 2.28 :■ 
6.r I 1.55.; 
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TABLEvlg 



1^- 



EVALUATION OP FAi^n M 59 PROIEGT^DIRECTORS 

i. . ^ : • AND 32 DEPAHTMENT:CHAIRPERSPNS^^:^^^^ 



J - 



Item 



I a Gmt a Moderate. | about ,|- a Moderate It^ Great ' 



I. a Gr^at 
I Deal 
I (4) 



Amount I the Same |- Amount j Deal 



I Mean, 



I 



• 0 



Effectiveness j 0 J olo 
-Satisfacti<on | 'tf I 0.0^ I 
Involyement^ I 0 [ - p'.O. j 



}*'^ BBI Ml 9^ m 00 WtUW^ 

■ PSOJECT DIRECTORS / 

0 I 0.0 1 13 1-22.8 \ mr iwMm^ m 



1^*1 33.3 

\:/-,v":. ^DEPARIWENT, CHAIRPERSONS : ■ ' ' 

Effectiveness "I ' O | ■ a h | o ' r 'n A ' ' 7 « ^- , ' , ' L 1^ 



... 11 
Involvement j b | 0 0 

....... . ,. V. 



I 1; ■ 1; 



0 r O;0 1:13 ^r^i^^^^ 



•1 



■erIc; ; 



if 



Final Report^s 



■ " ' f ; -0^ • In the preceding chapter saw that LOCI project directors' 

v^; ^ , reported ifrcre§s'ed"student learning/ greater student 

: :; ;satiBfaction, and more com service^.^s a. result of their 

' ■ reducei^: 
: - instruct ioiial cost; s .^aM WJtidna t^^^ • . ^ 

■ ^yP^^^l P^oj^^t ,d"^tor estim^ 

. V - y^^r were affected by his/oi-her- M^^ 
; Ta what exten^t^were prdje^ct: d^^^ 
; effects? This: i:s^^^:t^ To ^ 

.., answer it, we examined the'final ^reports .prepared by project directbrs 

for NSF. This chapter 'covers the characteristics- of projects fot 
.;; which final, reports were available, the .types of final reports 
-■ submitted, and the findings included in . the reports . - ' 



'■■ ■ ■; ' ' Method 



/ The 66 individuals who received LOCI funding in 1976 were ^ ^ \: 
expected to submit final reports to, NSF by Decembe/ 1^^8~w^^ 30> ^ 
™^^th? 9# ^ ^^^^ their awards. ' Reports ;f or projects fundfed after 

19!76 were pot due at. the Foundati^^^^ after^ December 1979 — too 



^v! . If for inclusion in our analyses. The 66 . i^ropo^als funded in 197^ 
|Wi^b«^^ popv^ia^ion of .interest/?^Ln^ this ' chapter For -reasons . 

• unikejjftl^^ c^^^^^ goals of . thi^ project , .^however , we were able to ' ^ * 



obt^ .C(s^e3 p£ prQ^al\s .far oiiiy 64' of these 66 projects ^ Because 
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. of the neceMity of ;usi^^ both proposals and 'reports, in our. analyfies.'^i 

• ; '^^^^^^l^^^^^^^ for 



• .^^^ reports available iri^li^O^ In/ : 

addition, in August 1979; we obtained copies of .all" final repdrts^^^^^^^^^^^^^^^^ 
[ J'^'^J^M^^:^^ LOCl-Project directors who had received ^^f^^^ in 

., ■•^1976v^^^i"^ docunie^^^xf|taiii^d -from ^tlie^^Itio sources' 'described 

Variables 

.. ; ,. reported 'in thip chapte^ 

familiar from previous Chapters:" ' ' 

. : again according to level '^hd control (Pepin, : 1978) 

■ . ;b) Scientific area--We:nbted^'^^^ project directors, were in .. v " 
, ^-V ; - ^^^^ applied, "hard" or-;^soft,r^ life or nonlife ' V 

■ - : • d 

submission of the proposal funding/ 

S^'t - ^1 °^ p^o^^ct^ e#^^cted.outc^^ 

.V- . eyalufltion^--We used the taxonomies described iii chapter: 
. ' classify 'projects^^:^^ respects. - 

/V v., also <fl%^ experimeiital result reported, in. the final . - / ' 

" ^'^"'^^^^^^ used a five-point scale V- ' 

■ going^firom strong positive t^ aegativ6. Strong effects were-; - ' ~ • 
yiose^ large enough to be . • ' '/^ 

;■ ; ^^sily :i^t|ed^^^^^^ example, final-^ ' . ^ 
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examination differiences of 8 .or 9 percentage points, differences in. 
laboratory costs of several thousand dollar^, and student . rating 
differences of one-half p^int' on ^ fiy^^^ scale. Strength of 

-effeCt .could be ^ d onlijr- for pro jects that xptovided ; 

quantitative results from both experimental and control groups (either 
cpiicfirrent or historical control groups) • It. was il^^o^^'b'l€t to code 
for strength of effect. when data were impressionistic or baseline data 
were ■'•unavailable. ^ ' 'y-' ■ '\'-.-\: f ''''^^ 

Reliability of CodinB ; 

Two project staff members independently coded.each r^^ 
described ii^||^h .report- for strength of ef feet Their average 
agreement on strength of ef f ect was.:;87% . Initial differericesf betwe^ii'!; 
raters were discussed until they^reached agreement about the = coding Jof" 
each report on each outcome, 



Results' . 



Projects With arid Without Final .Reports *^ ^ ^' .-. V , . 

'V . In most respects pro ject directors who submitted final reports V, 
and- those who did not' submit reports were indistinguishable (table. 
19) • Final reports .were equally .likely to be submitted by public and 
private ins titutiona; by universities, fout-year,ai(d two-year 
colleges; .and by teachers at various academic ranks * Scientific areaV 
however, was related to likelihood of submitting a, final report. 
Teachers in the ,"hard'^ sciences were moir to complete final 

rep^Xts ^^hari teabhers i sciences. Of the 10 psychologists 

arid social scientists who received 1976 LOCI awards, 6 (or .^iQ^^^^^ 
not submit final reports by August 1979.. Of 54 faculty members in the 
"5'hard" sciences, only 14 (oi: Z6%) did not submit final reports."" 



" i. ^y;^^" P°V^^ /•'^ analyses, we, were used to getting heartier^ 
^..iresporises ^rom neural scientists and weaker ones f^^^^^ 
.|^ndj^80ci.af^ 

. f or ;L05I^:^i^^^^ to our needs ques tidnnaireV ,We know 

°^ psychologists and social scientists are 

g^f^k^e^: responsive or less, cooperative -than othWr- scientists, 
psychologists and soci^L feel le^s idetitif ied with 

ipF'^- programs , arid, studie^^ is,.at .least one possibility to be 

considered itt-trying to ;Tnake sens^ of the'-perplexing differences that; 



we foufii "among scientific^j^reas. - ' ' - 

^^^J^p^s ot,^^^^ fina^ reports .were available weie 



8imilar^|^;-^^peii: of^ p on .whic^reports were unavailable (Tabled 

20) . ;it.i|fuld be ^heth^or not a ^ 

fi^iais report vrou?ld be su^^^^ based bii; kruiwle^fe of the ty|e of ' 
j/Ct. undertaken. ,^Nor coutd^we find any evidence that project! ; ; ' 
.lacking ^finaUr|)o:rts^haddisa^^ 

set them' apart :\'^*om pther^ pro j / ' 

Tvt>6fl of Final Rep orter?; : , •> ' ■ - , ' ■ 

The 44 final reports submitted by project directors fell into 
several groups:. ■ ^ ■ " " ' ■ ■ ' ' ■ i0^-y' ' 

a) Project summary only— Nine (or 2P%) of the pro ject di!^ors 
; submitted only a onerpage summary of p^ject results ^^^^^^^ 
.b) Bfief: technical report--^ total of 13 (or k%) 6f the rSlVts 
. , iQ^ud.^d a ' te^chnical 'report of from .one to I five, pages . : 

Other- technical repor|-^A total of 22 (or^0%) of the 44'^ . '^ 
. r reports included altechnical reporfof moiV than, 6 pages . 



Th| diversity of technical reports pairtly a result 

of uncertainty 1^^^ cJf NSF, One. project dirl^^^^^^ 

who- submitted a' two-^enteiice "technical description ,6f .project and 

results/' added the xi0te: ' ■ • . - 

P,?.lBase. infora lue of t type of t'^chnical suinmalry' of a 
. and xesults^rwhich are desired the Foundation /.^^^ project 
: director at a public university.) ' ; ' 

fixother pro ject d^^rec a dissertation that contained extensive 

d^*^? • -the ^citation, he^rbtec^ ' 

"' • ■■ ' '-^.-''^ • • •".;'^*:"- .'^'i':'-;-' 

. , We have not sent a of , this to NSF; Thave been assuming that 

. you do jiot want a di,^sert:ation. If^you do, we wijl- be happy to 
send a- copy. (From a* project director at a public university^) ; 

t^easuris ment and Size b^^^ Project Effects ^^'^ • ' — 

Projects also fel^^ into several ^^es when classified dc(;;grding 

to their method of determining outcoqis . ^Among the 44 final reports 

weire:'.' ' ^' ■^ . • \. ••■ .■ . 

V . . ■ ' ' ■ . . - ■ ■' ■■■h 

a) Impressionistic ^reports on project outcomes—These contained 

■ . . • ■ ■ • ■■ . ... j>- ■ . . ■ • ' • ,. ■■ .. ■.. ..V ■ . ' . ■ " . " d'" . ■■ 'CO 

no quantitative .results from. the coutse redesigned with LOCI 

\ funding and contained no results from' comparison groups . A 

•total of J4 (dr 55%) of the reports were of this type. 

: h) QuantitatS^e reports without control data—Eight (or 18%) of 

the final reports were of this sort. Outcomes were measured • 

, ' ••• •* ; • . . '-^^ ■■ ■■ ■ ■ . ■ ^ • , ■ ' ■ > 

in the course designed , or redesigned with LOCI fuhding, but no 

.■"■-.*'-■ • , ' . . (J 

tcontrbl or comparison data -were, collected or cited. 



c):jCQjitTtilled: c^ putc6mes~A total of 12 (or 27%) of . 

/the final reports^ontaii^d, results from measurements made In^ 
v'?^ . ' ; V - redesigned cd^rse- ami a control or comparison course. 

^. J : ' ''^ "^^^y^ 2]:.j>rovidfes more data on measurement of course outcomes. ' 
. • Gofumn- 1 gives; the dumber and percentage ofN the 44 .prpjeets that were 
: .deH^ned..tb Infl^ each outcome. -The data in colii^; 1 cameVfrom, 
: : : V Proposals;;describii^|^the^4^ 2 ^iveUhe'^numher' ' 

-1 • -of Prty ect^ire^tors^ p^ quantitative^measiareinent^df each " 

^^ ■ M-Jj^^^ach outcom^ in. tiie f inal^ Tepor^s . finally', -columns 4 and ■ 5 give ^ 
^::;.the;»uita)er proiect8.:^ropS;sing tb.measure' and actually - 
. v^-^. each outcome with a 'control ,lpr comparison group. : " . ; 

dlrectorsr^prress^ fairly ambitious goals for. their pri^t^^ ift their 

" ^^^"V cdllettion of ■ ' 

;. ^ • - quantitative dat^^bn comparison ^roui^ . - Iii' ;|heir i^^^ ' 
/ ■ ; . l^owever^ projegt^li^ctots measui^eci' less than their prbpo^ ' ' 

suggested they;wouW.' Whereas .50%. proposed to measure, achievement' ! ^ ' 
••S"*'^'^^^ pnly lezVindicate^^^^^^ finil reports;' that: tKey^^^ 

: ■ ; v in the red^iLned • ' 



course, 



A rfelat^ely small proportion of : the Vtdject^: reports provided; 
V -^vidence of^^trong 'effects on.otitcbme ineasures (Table ,22) Projects 
.producing strong effect* -were vthe following: vi; - ' U'', 
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a) 
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A' project to develop: desktop lab^ 
tl 




and "to ^ 



H'it s dn s tudeiit 



a 8sja,l 1-group j inquiry-bment ed i apprba .to laboratory 'scienc^" >i 
was ;«al8o a^le to demoiistrate substantial' effects of.-|he ';;v^ 
teacjii,ng me^^ib^ -ptoVlev^ ^gnit ive . 'fiiiictioning . Both of > 
these pxojec^ described an detail .in theYthird valume^bf 
■.this report-i'. ' ■; .'/./r'-.,' 'L^' :. 'V::.' :" 



b) 



A negative effect bfr s.tudient achievement was reported from a ' 
^proje^^ investigating hand-held xalcu^^t^rs as 'a substitute^!" 

' ."' " ■ ■■■ • • > - ' ' ' 

f or ■ comput er s • : TH^ prib j e?<^ d i'r ec tor repbr t ed 1 ess le'Arn ing of 
Fortran by students using the cklciilatdf s. ' : ' V ' > - 
Threie of the four strong Effects on student satisfaction' Dyere , 
I^^por.t'ed in courses/ given by K^ler'f^ personalized system :t)f 
instruction. The fdurth pro ject- reporting a stt^ 



.d) 



e) 



student sa||i8f actidnjused semi-pacedi'instruotion^a W 
the Keller plan for teaching. ,/ • : ' 

A strong eif f ect on the dropout rate was also oreported' in the. 
project using semi-paced instruct ibny"^^^ 

■ paced ;group were mote likely to completiB the course X less . 
likely tOy drop out) than Students taught by ^cqjlvettti^al 

--'.^'^'k . ■ -■ ■. .- - --"^^ / ■ ■ 

■ means ^- y ^^^o ■ 

, . ' ' .. ' . 1. • . ' ■ ''■■> ■ ^ 

Two studieiB reported reduced instructional costs . ri&iie- study 
demonstrated that the cost of organic chemistry experiments 
could be cut by recyc^ling solyentsrusedN in the: experitnents* ' 
The other developed computer programs that simurated^ 
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. • . . .- ' . "^^^"Sging'': ordinayily^dd^e hy^&a^^'exMk^iise^ computer^ - v 

• • his computer, science class" of MijQgO^ p^^^^ 

Did the final ^epbrts provide fevidence ;"of other i^isrtant^ \ 

■A ■ • - : ;.■■„?': ■.'■■." ■.::.•■■ 'v:' ■■ • ' : • 

outcomes? To Answer this qu6stionV w«{' review in the ' ;i 

: :feports: ^ Table '23 descrilyfes these a4d|^Joiai,;:ofttcomef of .,L^^ 

pro^e<:ts^ The additional outcomes inch^^^ 

.' ■c)^ .bpotes;, a[ud other^ k national ^ 

; i?onf^rences and meetings;, grkn 

: project?; a&dKawardMor .contributio : • : ^ ' 

y , V : ' Summary and Conclusions' ^ ' . >^ ' 

; ;In^ tt^elr responses to our questionnaire, LOCI project ^ir^ 
reporte^^ numerous positive xesu):t^ -from their' proj^ct^. The.purpose : 
' ; V; of . this chapt« was to determine t^^ to which thes^ positive ' V 

• - ^**=^;*°^.«^^^;^^^ly«^s^^ chapter came froA 44 -final i?ep ' 

V - • submitted by ^iofcl project directors who received funding in" 1976 
r • ^ Our general- in,pression is thata.G>Ci;project dire:ctors dd hot 

. adequately dpcument the .resultfi|of 'their projects; " ' , } ' 

, ' a; Only 70%. ^of project ditecjtors had submitted' final, reports of' 

• « ■/•..^^ kind, to NS^ within a 'year after thes* repter^ w^fere due.! ^ 
. M.; : : • - . Psychologists aild social-scientist? ieeihed to b^ is-peeially ' 

remiss in submitting reports on their work. ' '-^ ' 

■ : ■ ■■■■■ ■ ■■ j\ y 'rr- ■ ■ ' • ' / 

^ . b) Many of the final reporf^s^that ^firV a 

r * . - impr^sipnistic. bfle^fifth of the ayailabH reports consisted 

. • = _ - .y ofs^no more 'than a one-page sutfflnary of project results; one- 
} : ; > °f the reports contained fewer thag -five pages v Most of'- 

ERJC , • ', : : , / . : 81 f '-r ■ ■. ■ ; ' J v:. 



. : the .aVai labile reports were alsb largely impressionistic. Over 
half . lacked any description: of inea'sured course outcomes; only 
a quarter described results from both an experimental clasa. 
and a/contirol or comparison class of any kind. - . 
'. Only a small number of final reports contained results tljat 
suggested strong positive effects from cpurse redesign, . Less than 5% 
of the reports containe'd evidence of strong positive effects oh ^ • 
student achieveinent; less than 10% contained evidence^ of- stfoiag 
positive effects pn studfent satisfaction. ' The: only^ generalisation 
th^t seeded to be supported ^ ii^-.seversil reports was that 

stu^jjirtrs reacted more fa;vorabiy .to courses redesigned; to inco^^^ 
^ eatu^^ of: Keller '^s personalized system of^. instruct ion than 

they did to conventidnal courses . '^r^^. ^ . 

The .failure of LOCJ project directors to document their /. 
>5?:SQ5J*pJ-isto the 



> 



^^^r^^ * \ T t feeep s program managers f rqin syn t hes iz ing .the r es u 1 1 of ' 
'LQCI projects, effectdv^J^t In recent yearfe educational^resWrchers . ' 



have developed tooXs^ for objectively synthesizing applied. findings Itf'^ 
education and other areas, and these" tools can yield objective . 
generalizations about the overall effectiveness of l^arge groups of 
projects and^ about . the dif f^erentiaL ef f e^tiVenesa ^ 
-idiff erent types, - in different settingsV and sb on. In. principle, 
these , tools; c^' be applied to results from fund ing "programs such as . 
LOCI v •'but iii .reality the rj^isults reported by LDGI ^pto j(^ct directors 

are far "too imp,r^ssioni*8tic to be 6'£> use in objective synthesis . This 

■■■ • . ^ - . , ■ . •■ '■■ 

seeins , to us' a shame and a shortcoming: of the prograta> / \ " ■ 
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'^^5?^ • . ^ XABLE 19 ' ■ ; . 

? . -:■ : CHARACTERISTICS OF kk LOCI PROJECT DIRECTORS Smtijm&i^^ '- 

: - J:,. . . . and 20 not, submitting 'final r^ri3 ; - ^ ,' 



I \ 



, . . , _ . Not r '^ I ^ ; r | 

Submitting T -Submit ting v i 
j:i|racterlstiQ . . :| ; Report • | Report [ 



Chi- j Sig-, 



':yk-- '-'^ <--i^i^^-:^ . / ■■;~-7~^':---+--------------- 1 'Square . .. 

-Control (bi* Institution- | " I • j ' 

V .. \ I 3^.1 I :10 j 50.0 '*M , 

■ . I m l I - I ■ ■' •■- I ■*..j|fevv.-'- ^■ 

Leyel of Insmution - \ r/ [ ^W:-^] ' 

-..1 ^ l.-^'^W 3 r - 15.0 i r- ^;! # 

Pure vs. Applied Sciences 



Pure - " ! " • fe ,- i I 



I . ns 



Har< vs. Soft Sciences i I . /ii! .' 

Hard . . ... ■ 

Soft : r- • ■ ■ .■ : 



¥ j: 90.9 I -lil I Td.O ll i»..56'1 .050 
^ 9-1 1.6 I 30.0 ■ 



'."Life vs. Nonlife Sciences ' | ' | |. | - i , 

&^ife ' ' H • i I 22.7 j '. :8.| ilO.O I 2:03 I ns 



^■s;.. --Acad^ic Rank . , V r. v ^"^ ■ ,/ ; o ^ j ' ; ;' . 
^:^y^^,^Instructor/Assistan^^^ .-^1 31.8 1- 5 I 25 0 i 0 77 



I ns' 



1^ 



4.—: Sf •— ; — . - "~r 



/ '^tTABLE 20. 

[.■■.'•■■'■ " , '■ lyj^ \ • • ' ■ ■ 

:"l|3tpES OF PRpJ.Ec4svC0NDUCTED^ BY . HM LOCI PSOJEGTORS SUBMITTING 

li'., J'^'f- : i-. - - ■ iAND. 20 NOT SUBMITTING PTMflr. rrports ■ ; 



\ \ 1 Submitting | Submitting 
: Type; of Project : | . .Jleiic^rli I | Report 



?v Revision of ^^^iji^ Met^^ 
(Jomputetr-b^aed >^ ' 1 

.Individualized instruction. ^ 
Inquiry learning - 

. ^■^ Audiovisual materials Vpy -j 
Materials f>or disadvantaged | 
Revision of Content v / ! 

New or updated course | 

■ ■ ■ . \ 
i/- . N,ew or. upctatfed ^programs .; . | 

-;: ■ : ■■ ■ ■ . : ■ . -■:! 

New° interdisciplinary course f 




8i 



21. 



' ^^^^^^^ :pf MEAdtajNG lireOMES 

., . 'IHUlf PHOPOSALf-MD 1)4 llNAL REPORTS .■ 



■wV-.'T'.'-;'; 



1^ Propose'c! I ; ;|r ; 
Possible outcome |™^^^^^^ 



Sir* 7 



59^ i; I ■ 26; i; :59vi:j lo-i 22.r' I 7;j -i5vr 5 1 n : 



fietentlon 



Faculty Outooffless* I |: , V . . . , ' vA. k^W, :| ; -: 

'«^ti.f«,tio..^-,.-,.r2.;t^.^ 



other. Outcomes ^ | ' j 



.3 1 : 2:f '::.|.5 1;; g.o- 



i.. '.V. 



c 




:1S" TABLE 22 



S :^?a;Slfc EFFEp DESCRIBED IN LOCI FINAL R 




Out come 



^Student Outdonies' I 
Knowledge | 
i Satisfaction I J 

Retien'tion . | 

:i 



iv • • ^^fl^ : : strength of Effect - 

Stryjng/ Weaic |' '\ lir""""" | """"ttear"""r"'"5f^Inr"* 
l:: Po.itiv^»03itive. . | Dimrence j NegaUve I 'nS e ^ 



' Enroilment 




r 



-'1^ r 2:3/1 1 I 2:33 

0 1 -.0.0 Old ]. 

. ■ ■ I 




pth^ Outcoaea 7 I 1 . ^ i- . * • 

Ccftmunity Jk}^ 0 |i 0.;0 j < : 0 ^ j 0,0 I 



0 1 0.0 I ^-^'f . 1/^.3 
0 r "OvO f t) f^O.O 
?it> 0-0 l-^^ Ip^t 0.0 ;| -^s 0 I 0.0 

:0'^i--.,;o:i-o : I ■ .0 i,;,o..fr 




0 I 0.0 



0 i7Q.o. 1; ': 0 I d.o 



S7M.. 



3S» 



;Ecpnpic ; ^ .. \ ■ • i'i ' ' ■ oi 



o.p O'^j.^O.o 1^ 



0 I . 0.0 :i. f j • 0.0 
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TABLE' 23 



ADDITIONAL OUTCOMES XI 




' ' V Outcome . - > ; 



J ' . "^^kumber ^of \% of All 
{ Reports j Reports 



?ubiijshed ^ ar ti cles , chapters', e tc ^ 
Thesis, vinpubl'lshed .papers ."^ V I 
Preseritafc-ions at nali.bnai'l'coiif eren^es 



I 12 1 27.3 
18.2 



Presentatldns at state and local meetings | • f 



8-1 



:. . 'CAUSE, i^EP grants,- etc. 



Teachiiig awards 



I 

I 15.9 . 



I '.fei8 



■ -2.3; 
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i*.Overall Suinmary q^^d Gottclusioiis 



/. .• evalu^^ii^^ was d to answer questions in four major 

: aTea.3. ~As listed in the introduction to ^the report , these areas were: 
the need for support for local course imp^rovfement; response, to the . 
LOCI program r outcomes of he. program;' and the program rationale. The 
aiQitlyses' descr'ib.ed^ this yolum^ provide'^some ianswers to questions in. 
' 'each of . the. _ four \areas> ' ' " 

^K-rrr-^^:'^^ fi^st aMa~nee<i fbr local course ^ , \ 

•vfj i^^ questions were of interest. "What / 

C ;-i?y^:4ettt|fe^P«8hthat' in^^ outi^t3;<3§#aBsistance, to keep up 

^^^^^^^^^ impiprtant s-cientjific and iMlBSi^ 
.^^^^^^ in different types^'^tof: institutions,..and -in . ..[y^''': 

^Vdifferent S'cientific fieldte? : . / . ./ \Ul' . 

To answer, these questions^ we/mailed a-questionnaii;e on. 
m^^W^^^^ '^^^ ^ national iai^^^af cfol4upge .teachers, ' 

yl^: responded s^d tha£*sclifeii^e^eachi^ needed, improv^ent ^ 
- ' '1^1,, that the sort s djf'fs^^^^^ provIdT 

l^^i't ^f^^^i^ Science 'cour sea, that^'slppo^ 

\^<;myixnavailable locally at the vast majority ^ insUtutip^^ Nearl;y 

half the/respondents to^oijr .purvey , fojv example, s'ai^ .that ^ summer^ V 
■: salary and released tiS^f or work oh bourse Improvfeft^ are sound 
. inve^9ients that pay substantial dividends totcolle^es,/&iit "nearly . : 

-^^^^^ ^^^^-'^^^^ ^^"^^^ ^Vary ^nd released 

time \^ere^not w^apJbt^at . thei 



8r 



••••• 



. ; . Perceptions, of rieedg a^d resources were very sA^ar in different ^. 

.areas of sciences but} differed 's^^ at different^^^^ltuti^n's. . . ' 

Pefcfefved needs were highest- at community cblleges, 16% at four-year 

colleges, and lowest at univer.sities..;x.:Resources . of t 
■ proyjdes ^ere; perceived ; as more^ effective by tif^ 

colleges an^ fou^year colleges, :^and, were see^ls somewhat less ' 

effectiy^y,. faculty members at universities ."^^ilability .of ^ these ' ' 
.resources was reported to be W^^^ low- by teacl^s at all levels of 



inst itutibns . 



.T ; - The. seband^jia^ area, 6£ .conceirn was response to the LOCI ''^^ 

■ _ : propam/ . Specific :qu^^^ in this. ^rea were: Dp applica^|or^: 

■ V ^ "P"ff°»^;.^^Aull:r^^^^ institutions an^i^scienti^iS^^ 

y . . ^ i^re pioposalS-a^ consist^t^iJth/establish^ needs / r ' 

C^^Sr ,.v#^^°'^^ the ,k«Sd ;of the . ■ . C 

Vvv J;^-- 1X)CI diversity ofesits. applicants, : The LOCI ■^togrfi. ; . 

. -/. ^^^^akp itf.a-yafuabl^ 

■ ; / ;5^o^ndl^tipn iaakes con]^^ : f 

; ^ .;:t;eachers at;^ajor r^se^h univW^tiei-^^^ | 
.. ■•V^'^^<^ileges not^adi^ research; ■ ' • 

; A^hpugh. ^bei Rroposals --CSme^ frok sources, individuals 

. • ■y : ■ : \ 

'. • A. ^"^^^^Se;^ science; |e&ch^^ .utiiversit ies knd f qur-^ear "■•^ 

,c0neges sv^ enrollments^ . ' 

. ■ ;:™rtanted^;^y^„nlty .;co:iUgesUu1,mit,red- f ar^fevrt thin Vheifc^ share of .■• 



FRIT- : -r^-KA - ■ v-^^ ------ ■ - 
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^P^P^p&^)-s* --SecoTid, private' institutions suBmitted more proposals; than 
*xp6ct(ad-6ii; the. bisis of thfir' enrollments; ' puVlld instituVi ' \- 
^lUbmitted fewer . ,'And f in.allyir"^^^^^ mathematics 
cbmputer sciences-', an.d engineering. 

.0^ the proposals while the. t'i^Jogical sciences , sbp^^ sciences, and 
psychology submitted fewer. proposals tharf: expected. Those 
institptlt ions and fields submitting more than their share'of proposals 
were ncpt; thos^fe wit'h th^^ need^ or fewest i;<^sources If 

anytWng, th^e-^^pppWi^e^^ true, fiut : institutiotls and f ields 

submitting m^re than th|ir sHate of^ proposals may be those with the 
strofngest traditional iJjaks to^^^^ ; : . :v^ .- " 



^ scient 



^^Pr^^osals -from differe^t Hypes oiV'ins^ 

-V.^<?>#Ji41d3c^^ same bhance /Of sjicce'iss in jSlSF^s review 

proce8S:=«^(^ in, f cgar i. . Institutions .and f ields^ that> sul^itt£<i ■ - ^ 

3.V^?^^^ many^,!^ awards; institute fields'^hat 

Th^ review of LOCI^ . 

\ ' -Tne thiacp ^major area f cfr. evalu^tidn was the outcqme of * tlie LOCI 
progrfita, Here we weiife con^^tied wiib, such quesjions as vtAese: : To^ 
what ext eqft) lo pro ject&^achieW'' thei^^^^^ ives ? Whic'h^Bbrt pf 

^^^^^^^^^^ 

conto-ibut.e tp their success? Wjharaje thejtaost' promising practices' " 
that have been. -develcped in LOCI pVojec^|s? Oux data' to answer thes^y ' 
questions dame from ..two ^;d^^^^ ^ources: a questionnaire suirvey. and" 



^^^^f ^^^<?rts f i^ •The^ two data .SQurcqS 




.gave different "pic tikes' of LOCI oi^ifcotaas ^ 

■ .... 'v " • ■ ■ , --^ ^ . -• ■ ■'■ X 
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Replie5\:from a questionnaire to project diisectors showed t*at 



considered their^projects to be very " , 

Uei'r benefits for their 



ii^^lp^ directors rfepo? ted 'cle 

> and most project dfirector^' also reported 

contributed to th^ir |>rof essional devej^ment 
. : ; When as^^ about the curti^^ nearly threes ■ 

^ q'farte of all project directors. reporteiT ftliat thpir prp jects-l,ould ""^ 

; • X ... -- be continued in either 'original, or expanded :foi^Many al^ repfeed 
: ^ that :t:he products of their LOtff work v^re being 'us^d by others »eithe? 
' \ outside th^ir institutions/ We were unable to find, any 

° ■ relationship , between success o%projecj|^:?^^^^ 



^■4 
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-directors and cha!i 



istics ^^ .the institutions'rana^ depatlta^ 



.:. " wtiich LQGI projects, wer/ carried* out. 

.y' ^ . LOCI project directors^ however, did not document, their succesfl-es 
effectively in .final tepotts ta NSF. ' Only, 70% 'pf the- pro je^^^^^ v ^j. 
■ directors: had . submitted re^^^^fUny kind within^ a^ y^; after thk '^M: 
^^ep'ttr ts w^r e, due . Mo s t of | 

■ i»P1^»^istic and brief ;'ji^)ouJ||a|E lacked .quan?titati}v<i^esultSi f,- 
• and aBoufc .t^ee-qui^ers lacked, datas^from any sd^t of cpntrdl or/ : / 
■ ./r corner is^ ^r^p , . Very fey of the; f inal^ reports d^mpustrat ed : s trbng: v ^ 
positive effects of LoCI I#bj^ta;-oa studen 
satisfaction, instructional costs or 'any pthef quant 
t%ina^|PUctional •outcome. 



..1- 




• ;• T.he fourth.-major area for evaluatib^i was program rationa] 

' Cpncernis in this area included guidelines- and restrictions on awards— 
the level of support, 'degree of structure, time allotted, and so on, 

.•|.|)CI guidelines and, restribtions need especially careful; examination 
' in two areas: project eyaluation arid, final reports . 

One of . the most striking impressions from our reading' of 324 . . : 
funded proposals~was of the general weakness in the design of project 
evaluations. ; Mpst projects were not committed, to collqctiori of "any 
sort of data frpm a control or cpmpari§p^ group /.and without such^data 

. conclusions about^the results of revisions anji innovatioris are Seldbm ' 
convincing . This is surely ah area where better guidelines can "be . 

■" • ' [ - . ■ . ■ * 

- written fpr faculty members writing proposals and for reviewers 

■ '•■^ ■■ ' ■■ . ■■ . " ■ ■': :. ,>) ■ ■ . 4 ^ . • • • 

reading them. . . 

. V Guidelines for final reports also may be inlieed of improvement, 
A 'few project .directors said tha.t^^ey <fid not kriow wbat NSF's 
expectations for final, reports werej More ci^ity in guidelines foir^ 
. 4' r^rts m therejEpre be nedessaryi, but LOCI also;, needs 'guidel'i^^^^^ 
-|^>|^ project directprsvtp/submit'reppr^^ w 

H^ilfh^t .cb\i|.d b^ synthesized effectively by program^mahagers v In > 
.r. principle|, tools for qtiantitkti^e synthek^^ j 
applicable to'.resuLts of :lOCI and UjifixJ^SF funding, programs But in' 
Hv^ J^f^^^^ty,. these- used qa'i^OC^^f^^ reported 

^ : J^^^ far top imjyre^sitfnis^a^^ Opinion, " 



V .this 4retf, mMe than atiy other! i^eds c attention "of^NSF : 



Ref eifences 




• ^^^^^r ^'^ -^^^ characteristics of subject- matter in^ferent 
- . ■ l^^:^""^":''. °f Applied PS vhhol n^y ,1 q} ... 

- • ■'■ -fit^^f*'^^^^"' /■ - 

Calii«^^,State^Unip»^rid^C^ The mwrn. .H.n.;.. 

the Chancellor, The California ;:^S^niv2rsity and 

^ggR. H. , Abedor^ A. Witt, P. W ■ F. ; Commj^&nt to 

. : f^cellence: A - case / st-i v di. of educational innovah-fhn \ v.. 
rjiansing MI: Educational Development Program, Michig^ 

• r^^'^^fversity, 1976. - • ' - ^' 

^^7 Si The .nation^ f^>'m^ v directory 107^ Detroit 
/ MI: Gale Research Company, 1978. . - : ■ .■ ■ ■ .■ ■ "^^^°:^^> 

Kozm, R. B. Evaluation of the -imp;.rt: x)f four ^n«f;n.f4/^^.i . • ' • \ 
pprovement programs. Ann, Arbor, MI: Center for Re"-^ ' 
Learning and . Teaching, University of Michigan, 1979 



nro* i & LeeVY..S. Outcome measftrp. .^;<m -:^ 

. . . P . rocedures manual: Field review edition rTo.i,n,%.i n^j.-^,^^ ^^ qj ^ 
Boulder, CO: National Center for Higher Education Management N 
Systems at Western, Interstate Commission for Higher Education, 

. National' Science Foundation . \ ■ 'characteri^^t^c s 6^ flofetor;.! c.^^^;^...; 

. . and engineers m the nnifed S||tes.. t97S 1 j ^WQf. ^'"'^^"'^^ 
» ■ ■ . .W^hington, DC: :N^^ tonal iSci^ Foundati^i^ *^ " 

PeEiri^,A^ : Fall en^Ument ;ih^ l^^^Sngatian IRT^r. >irfH^^ -. .^ 

- V Washington, DC: U. S. T^^P-rt^^^^ ^ 
National Center _€or Education ' J^J^^^^ 

'^""tl^h^^filJ .-^^^^^^^ J- 'Traditionally inc^f>■„W;>.^ygj':^ : 

^iRher e^dUcation; their identification and ael^^H^THT " ' ^ - 

characteristics . Washington, . DC : U. S. Department^of Health. 



Education, I Welfare, National Center /for Education; Stktistii 




; ■ ■ 
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THE::UNiyERSITY OF ^IICHK^Sn '^^^^^^ --^ 



The (Renter for Research on^Ledrning and'/Feja^jng 



: 109 E. MADISON STREET _^ 
ANN ARBOR. MICHIGAN 48109^ 




•May 16, 1979 



Desr ColiVague : ■ ■■ ■ \ ' "' 

' - : ■ ■ . ■ ■ ■ ^ ' . :;■ - y--'- ■ . 

^« Foundation has . asked the University ' of Michigan • ' 

' ■ ' ^^^"^^^^ °f it^' Local Course Improvement CLGCirtro^ 

'Ss 000 t^.'Tr^f'"' Science; FoundatLn. makes riwSS^a^^^^^ 

content o? clWlf" ' ""Wi>i.e^Vfor tI>e 'revision of tHe methoran'd^ 
conrent ot college scaence courses, 

°" se^rai different questions: " Can 
lostitutions keep up with: currently important scier^fe^and instructional 
SrJ^?r"^"''5°-' °".^^Vj^3istance? 'Do .apn^iSSff^ 
-the full.r^ge of institutib«^,.an^ scientific fleias? : Tolvhat Stent do^^ 



pnrio^''°^^ ^^1^'^^ke ^the-^S^W/lO minutes- required td' clpiete;^-^ " 

-enclosed^que^^ionnaire on:; needs, in. college science teachirifit- PleSSe?S? ' 
^^^e the 5ncl:os^6, pre-addressed enVel^e Sy.MondS^lle^Js. 

The. ;^mation you supply Win be -treated with, utmost; corifideLe 

. We can send you a siimmalry of our firicilngs . you would like a" ' ^^-^ ■'' 
, summary,, please complete the enclosed -postcard and feturik t^^ . ' ' ' 

Sincerely,'*^ 







'ames -A. Klilii 
Res earch Sc ienti st 
and- Asgociate'^&iyectQr 



.i fc ;. 
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A..-.i~NEEDS -.ii^SC I EN(^E^ 



bx)x^v:andicate how •stfbrig' m§.c6Rsider. each . rieed to -ie j^or^^^ 
: : -^yoiir- v^in-st i tut ion . .at-;^he; pres ent time h^k4^^^^SS^ '--^^^'^■'^i-'l^^^ -y;^: 



■ In" your- judgment , liow; strorig. a need ' : ^- -v.. ^ 
, v is there, for each of • .t^;.,£6^^^^^ 
. / your field, "at -your ihstituti^ - ' , 

■ present • time;?/' ■ ^ /. ■ ■-'■ i^y ^■'^'^■'^'i^^ ' - \- 

v. ^^^ ■■■■■■>• / 



V. 1 . ^ 'Revising^' content of I trndergra^luat^ courses \to incorporate 
V.;^^.n'ew djevel.o|me field. ' , , : / ' 



.2. Increping/.the use^of instru(jtional technologies , such as: - 
■computer-a5siste4. irtstr^ instrucrtpnai video, etc . . • ' 




^^/T ■ ' ... 



3. Increasing the use'of .ind^ividualijed/^^^^ as 
■ tutorials, /self -paced ■'si:udy,:/'mastery.J||^^ . etcV." . 



■ 4/- Deyeio^dj^^ pvogvkms^gea^^^o recent ■ 

v; :// v^<:?i^S*f mm-i^ Uev6iopment3?0'^'^^^^^ ' 



.<-5.'. .Incj-ea^ia^^ number of -students- who/'^uly^Tnaster the. - : 
. " content^'w^caiirsekv . ^ ' ■ ^- '"^ ' ^-^^ /^ ' ■> 



^ 6. Increasing student ; satis cbu^sei^. ' 



.7';.; ihcfeasing' uitde enrollments . 

^ ''' ' 



8. " 'Detcreasing dropouts courses. 



z?". / Providii^Vbppdrtunities"^^ cbnt4nuing:;educatibn ,for-: 

^'^ ■ ■ ■■■■■■ ■ ■ ■ ■ ' .J... ■ 
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i^E^^l^^^il^^g^! f jihstttution^ might^^use.td' iniprcjve tirtdeiifaduaie. / 

:^(^r>^y-^?n?i;*^S^:;the^resoarce^ t in improving VcblLege . teac^h 

;,-. -v;avat^abiiity ot:.the :r^^^ to teachers in yoaf ygiiid at your institutibr?.:' ; 



^I•dr• eacH^•item, place an X in the ajjpropriate 
box "after effectiveness and another X in the 
appropriate box^ after availability .. 




I, Rel^sed time during the academic year 
■ ^^^^ wprking on course improveme^^^ ' 








• 




Availability': ' 




• 






■ ^^•7V^:'^;imp^9vement;^^^ ' .■• ■^v'^ 












.Availability 






i ■ V 
.- ^ 




: ■ -I^nfe tp ^ trav-ei related: tb the^^^;^^^ 
improvement of teaching. . . 


■ L^X X L J. V v^liCd O 

;. r 




-.. ■ .•• ■ 




■ 


•Availability 










i' /4. .. Small grants td support teaching 
• inrtovatidn. ' 

. ■ . ■ -. -»- — ■ ■ ■ ■ \ 


Effectiveness ' 










Availability: - 






- ■»* 




V'J.S* : Gonsiiltation With specialists on 
■ ■ " teaching, improvement. 


Effectiveness 










v Availability, 










6.. - Paid assistants fi.g/, g , ^ ■; 
students , or techhieians to heip^ : : 


Effectiveness 










^^^^-^^^ ; -f^^ imprdvement}-, ■ 


.Availability 











Comments : 



■ ' V /■' ... 
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PLEASE CONtlN'UE. ON THE N'EXT ,J^A€£' 



^ answer* the following -qi^SraW . 



Please 

1. r Whatv is .your :highest comji^flKd' 



le? Y'C*'?^^ - ahswoT only , ) 



=^|=Bachelor±s: 



Master's 
* - [3 Doctorate 
^ , 0 Other,' specify; 

2* : What i'§ your academic field of 




IvTiat is your academic 'rprIc?^-Kfar^M 
1_J tlnstructor ■;.-fV .'>^, X"^'''' 
; AssistaStJ^professo^' 



1^ As|£iciate professor 




essor 



/I^'fiepartment chairperson 



.■X- ■■ * ■■■■ ■ ■-. -•■•-Jli.^'' • '-■ 



■-y i^^ fe-g- > Mice-president /'aeat%fi^irect;^af^ center, etc) 



Specify 



'v^:. : . . . . . .. .... - . . . . - 

^ /^/:4^.^^^^^^^^ you .teach at least one undergraduate course during: the academic year 19:78-79? 




THANK YOU VERY" MUCH FOR YOUR COOPERATION. 




Outcome Questionnaires 
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Ann ' Ai-Inh'v' MirKigan . 



Af)rii 5/1979 



T|ie^ Ndfvibna I Science F^^ dsfeed The Univere Michigah fed^^ in; ' ^ 

ffie evqluafion of its bocal Cwree Imprbyemenf ^^^^^ 

the Ndtjpndl Science Fbuh yp to $25>0Q0 to college dr^^^^^^ j- 

$itl« for the revision of the metlKKj dndfcoriteHf B^i^e 1977^^^^ 

ih€»e dwdr^s Were kndWn ds iwditj^-^lent^ qw^ dn^RstpajfuFffig tf^e ; 

Urtdii^rady^te ie^ tWJL^* As d:d^ipieribdf d tOGJ or RUtE'pwdixl / _ 

can help US iin this evaluation ' , r- r'^^^i^t--^^: ■ ^ . : 



Our evdlua^ several di^^Pr^^^ questibhs: Can ihstitutions keep^ u^ - 

with can-ently ift^^ and instructioridl deye|ppmerits.v?it 

tdj^e?. Do dppiicdhts for dwards r^resenf ' the ful 1^^^^^^^^ of institutions dnd scien^ 
fields? to what ^e^^ objectives? Are prdgraW^g^ 

lin^ and r«frictidjjs rwsonable?^^ ^ V V ^ 



: In eyq iuqtihg the butcbm« bf funded prdjecfs , we ybtir cboperdtibh . You can 
BiS^^^rovidjng^ about your pro{ectt| your dss^^sment of prbject butcbmes 

fereen^Sl!^^OTd4se) dn assessment of pro jecij outcomes by ydur depd division 
head (blue que^fionhdrr^ j <? ^ ^ ' 

- Your dssessmehf of pb{edf qutcdroes: We hope f hdf you wi j I tdlce f he 5--ID mindtes 
need^ to fill but the eriqlibsed oh project dutcdm^i Y > 

return the qutsHonnaire in the enclos^^^ pre--addressed enyelbpeV We^ 
that you Will send us any reprints > prepf ints ; of f epdrf s f hdf you have dvqi Idbj e on 
V. /;;>^ur ^fsrQjeqt'dc^^ V''-' --V^ ' - 

; :^ Ass^ment of prdiecf oufddm^ by Pledse.giye d 

: iopy^ 

■^^■^dr'^diyisidn ....... 

We can send ypu q summdry of our fihdiHgs. If ybU Would like tb receive d report', 
piMse cbmplete the ^hcldsed pdsfcdrd dnd return Tt to usi . ^ 

" Please return your questionnaire^ by Monday, ApHI 30/ T979i The ihformdtibn ybu ^ 
supply Will be treat ediwif h utmost cdhf fdehce ; [f you^ have any questions about bur study 
br db^ut the que^ibhndifes> cdll me cSIIect df (313) 7S4-0505i ' 
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Jdmes A s Kulik 
Resed rqh Sc i ent i^t qnd. 
Associate Director ^ 



The confer for heiknr&k 



-V • J AS.SBS^NT "OF. OTTeO^ffiS^'^P^^ 



This :quesGionnaire: cdrieains a liumljer of quest^^ 

oute9mes^^6£ ,75ur^ ii0eiB li will take .ab?but ^ ' 

■'■- ■■* - v. ■ ■ * /■' ■ > ' ■ ■ ■* . * — ' ■ .- ■ ' ■' * ■ •/ ' ■ ' 

: 5; to ld _mUjjut,es^t^^^ Pieas.fe' re,feurn tHe^.questionnaire. . 

in_,the eiiciosfed, . pB4-adfrisSed envelope By -Monday*, ftpSii 30;, 

The informa^tion yoU' supply *tjili 'be treated with. uWost confidence 

If you have any vq^^^^ please call 

James Kulik collect at (313*) 764-0505 . z •/ 




- ■■ ' 'St.: ■: 



ERIC 



:~ ' - OVERALL EVALUATION ' -s ' - ' . 

* 1., Please, indicate your overall evaluation of ypurrprojec^ by placing an X irr the . r* 
apprQpriaCe box foi>*€ach question. \ ^ ;j ' ' . . 1 

" ^ 'DEFINITELY EROBABLY !, PRQBABLY DEFiNtTEtt;-. 

NOT / , NOT ' pNeERTAiN * ' *YES IyEs' 



a* Do yoa consider 'your LOCI 
project a success? ^ . 

. - bi Wast youf^OCi projecp. worth 
the'effdrt to you?^ - 

€•> Wc^uld you consider, another 
LOCI prefect? * ' * . ^ * 

^ h - ' 

d . Do faculty :in youp department 
^ : or division consider your LQCi 

• ^project a success? • ; 

^» - 







y 


-•' -v^-.'-g-l 


ir. 


— 

\ ■ .. ■ 


^ 






■ ■ * l> ', 

■J . 




J • . ■ • 


— — \ ■ ; .1 
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• 1 ■ . 














.-■ 


1 
1 




■- . ■ • \ 

- ■■ .• ■ • »• 



INSTRUCTIONAL OUTCOMES V 

_ ^ _:j _i — I ^ ♦ 

:. 'Z. , Approximately how many ttndergradaate students per year: were affected by your proaect? ■ 

- . i AHou t^- ; - ^ . stuaents each year ■ . .■ 

V 3. Fl^ase indica^e-t^h'e^ exterit to which^your project lias contributed to instructional' 

i^ff ^ctivenes^s;\dn Athe f ol!iowing-^^^^^ Fot each item place an X* in the appropriate box. 

" -^'1^ •; , ■■ ■ ■■. ■. . ■. ■- : ■•■ - ■ : •, i : ■ ' 

■ • .■ .■ : ■ ■■ ••■ -l ' , ■ . : • "TO A : • 

NOT AT ALL SLIGHT^^Y :e0NSiDERA:BLY GREAT EXTENT 

^ . (1)— ;^. (2)^ : - . (3) f^^^ ^ . (^^^^ 



a. . More., students learned the 

mat^ial. ^ / * 

b. • vStud^ts retain what-j^they 

learn longer. 

c. Students enjoyed the 
experience more.. V 



e. 



Students learned something " 
different. ^ 

- * 

Course or program enrollments 
increased;. 



;f . eour,se.or program 4.ropout^ 
•:: ■ decreased ■ -i 

. Institution Vs 'Service to " its 

.community Ifhcreasedv . 

hi' linstructionai costs (pet 
student) decreased. 

ERIC,. 







\ 

- J • . ■ ; .. . 














j: ■ ,- • 

/■;..;. 
















1 ■ : ■■ . . 










I . ■ ■■ 




' — !— * 


■ ■ P 




: r- 

















In 



y^:.:^:^ -^f^^^T ^^^'^^:f^-^M'^f appropriate box; •• ' - : y'''^^ -'^'^'r ^^(i-: For., 



degreased;,^ decreased ^ - stayed; . increased ■.increased'' 

A GREAT A MODERATE AB^UT THE A. MODERATp ''a-.^REAT 

...•DEAL. •. AMOUNT •■. SAME' •• AMOUNT' - -DEAL-^ Z • 

• .: (:l):v •. . .(?). . -CS) ..(4) .(5,)^ -.. ~, 



:^ .a>,.; yYour general effectiveness 

i!;:^^- V. • ^ as a -fcfeacher.. ^. ■. .>:: , 

-'vV ;.• ; ■ -.J- • . , 

V. : '^^^ r ^9^it • lerise^^^.o^^^^^^^^ 
satisfaction^ 

% c» _ Yoar involvement in teaching 
, Improvement on caApas, 

r^,:d. ; The extentv t^ wh ^ 
. - : faculty have; contacted yoii 
, . • about teaching improvement . 



CURRENT STATUS OF pkoJEGT*' . 



atusTof-TOtnr-proTtcf-^rT^ the fbilciizing 'que'stiSns; 



■a. 



•■■;■■■••- --4'-- ^ •-■ •■^••: --i^' ■■■^•• 
the preseaE s t a"6fe" of the resai ts^ 



. V.' * 



7|v 



Which of, the fo|ibwing descrip^^^ best wwcxi.auut;x 
Vpf /you& project?; .the :one most ; a^ropriate 

r::It iwill-^be . co^ in In; expand ed^^ 

4 It will be •cbntinuea' dn-: its -^origina;! : form. ... 

\ 1^^' -^^^^i 1 6^ : -con t .r .but;: f 1 th r educ ed . ,st 5p e , 

.It was. oir: will :;be c 



'^i^^ ;feDwiedge,: is the_prbgram or. cbur^e. you' developed being used irr^fioie^-^ir- in" 
part ,by other instructors^ (Check any . categories , for; which ybur .a^sw^,,i,^ 



In your depar tment ; 
;:In other departntents. at your instituti^ < 
1-3. '^^^^ Qolleges or vuSiye^ ; • ♦ 



-v, 



Fi5EA§r'tbJiTiNUE-0N;;THE ' JffiXT 



,6\ Pl^aser complete the following A • . 



OTHER 



a^. ''intat is your academic field of specialization?" 



*b.' What is 'your academic rarijc? (Check more, th^^ one/ if applicable.) 
Q Inpatuctor \ > . / , ' '\ • 

^ , jT^ ; AsliStmt professor : *^ V ' -t'?'-''^ ■ " ^ ^ ^ ; ' 

^" v ■ ■ • ^ ' •• ■ ^ • ■ ■ * ; ^ 

^ [f^ Associate professor v ' : ; ^ . 

. Department chairperson . v . • * ' 



^'^ pTi^ vice--president^ ; dean; director of- counseling center, etc.;) 
, Specify ^ / ;_>;ri 



T«ANK YO^ VERY MUCH FOR YOUR COOPERATION. 



ERIC 



>rr .'J 






V.;' ; ■ .• . ■ • 













■ ' THE UNIVERSITY pF MICHIGAN 

The C^niet for Research oh Leflrhing ahH Teaching 

• ' - ■ " 109 £. -MAOISON -S TREET ' ■ 



VANN :.\RBO'Ri . MICHIGAN 48109 



April 5^ 1979 



Dear eolleagae: 



The Nat;Ldnal Science Foundation^ h bf Michigan' • ' 

to assist: in the evaluatio-n -of its ' Local Course . Improvement aoGiy pgolram 
Tb^oagh: this pTOgr^^^ Science Foundatibh m^kes'^ awards of up tb : • 

^25,000 to colleges. and universities 'for .the revision of the method and - 
cpnt^n^ of : college science, courses 

. f acuity-oriented - avmrds, in- NSF^i pr^ ' 

.; Learning vExperierice(RUL^^^ 

received sjappprty for a LOei RUEEVp^d^^gt;^ /^OU ckn ■ Help us iii this . 
.-■■evaluation^- ■■^■■v-::: ' • ■;:;■;- "'■ v:;; : ^: ■ \: ■:•.■■!-■• ■■;:::■: ^' -i- 

- ^"5*^^^^"^^^°'^ will f dcus^dn: severai^^^^^ questionsi Can 

institutj^ons keep up with ^currently Importang scientific and Iristructiohal 
developments without butside^assistance? Do applicantsjfbr awards-represent 
the full range of institutions- ^and scientific fields? TbJwhat>'exterit do ' 
projects achieve their objecfives? Are program guiaeline? ind restrictions ' 
reasbriahle? ■/ • ■; ' ' ' - ' 

: , To^evaluate the outcomes of LQCI or RULE projects, we need your 

cooperation. We hope that you wiir take the 5 to' 10 minutes needed to fill 

put the attached questionnaire on project outcomes. Please return the . • ' " 

questionnaire in the attached, pre-addressed envelope by /Monday, April 30. : 

, .The infonnatipn you supply will be treated with utmost confidence. If ' 
you- have any questions about our- study jpr about i the ques tionnaire , I wish 
you would call me collect-.at (313) 764-0505. ' ^ « . - V ;---, ^/^■■>-. 




-^ames A,. Kjilik 
Research Scientist 
and Associate Director 



bVERALt EVALUATION ' 



&i^7^::Pl(giase;^^^ the; j^rbj ect by plaqirig ; Xi iii tKe. • 



■11(51:: 



. : •PROBABLY . - DEFINITELY 
UNCE R TAIN Y E S ^ ^ - ■ . - Y E S; ' ; 



(5) 



ai, ; ; Kas: thg;: ^prcrj ec t' J^^^ 
^ ; (iejpat tnfen t \a^ subiejs3 ' J:;' 

b. Was the LDGi project worth the 

of yonV -Pflrrtlri-v? 



■'C Would members; of your jiepa;rtment 
> ; ; cdnsider and thef LOCI %r d j ec t ? 

■d/:. Do faculty in-^^^^^^^^ departinent : 
iy^^^ tfie;,t0Ci. 
: : > V pfdjec success?' ; V ' ' 



INSTRUCTIONAL^OUTCOMES . ; 



■ ;V A^ hpw many undergraduate:: students, were ^ff ec ted by ;$he;^ ; > 

^^■^-^ : " Students each yeai: ; \ \.'ry * '. ' -'-y 



3. Please: indicate the -extent to whi^h the project has xpntribut^d^.to' instruction 

effectiveness in thi foliowihg areas . Fbr^ ^e piace;*an X in the appropriate boi.\:. 

• - : j . ' ■ : " NOT- AT ALL SLIGHTLY : O0NSiDERABLY : 



More students learned the 
. *i> material. - j - 

:b* Students retain what they 
learn longer. 



^ c . ^ Stude;ntsr enj oyed the 
■i -.: . experience more; 

^ d • * Students learned something 
■ different. -i^ 

ye. Course or program enrollments 
increased. 

f ■. Course -or. program dropouts 
, ■_.decreased.^ . .■• 'r 

g; ; Insti se'ryice to its . 

: : c6mmu^|y increased; ,: , : : ; 

(per 

• student^ decreased . . 

"■"o'-'; .. ^.•■v- 





' i ■> . - ■. ■ * 
.. " " ■ ■ * ■ ■ vr ■ : . . 


. . , ■■»■...• ■' 
— — — ^ — . . ■ \ • — 






.... ■ ■.' • ■. ■ . 
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'■ ' ■■ V"' ■ ■ ^ 







Plefse. Indicae^.whetMr-.th'e^fpllow^^ broVect. -for '' 

w/. each, item place an X. the appropriate 'box; / . . . x V • v*. . ' 



decreSseu- d|lckes:sed .'./'stayed ' increased ' ^ IJTCREASED 

^ A' GREAT- > ftODERATE-, 'ABOUT THE- . A MODERATE " - 



DEAL 
(i) 



AMOUNT 



SAME 



AflOUNT'' 



. -.DEAL 
(5) 



a. . Project director's general 

. effectiveness as a teacher^ 

b. . Involy^ement of project 
- director in teaching 

iiaprovenient^ pn campus i 



\ ■ ■ f ■ 

■ ^IL/-- ^ 


■ A 






, . . .• - 4^- 








. ■ ' 





.•;.Te:uRRENT;;S:TA^^^ 



; 5/'. Which/of . th6;^fbilowing.d% best characterizes tfad/ presen^ state of the results ■ 

of the project? , (Check . the; one most ap^)ropriate descriptionO ' 

♦ V ■ : n3 v It -^ill/ lie cdntini^d in'^n: exgaSaed' form; ' 4 ' ' -.r^^;- • ■ ■ • \- : ' 

;it -wtlltsb!^^^^ in: its original^ joi^.-' v •* 



I^^^iii be crfntiniifed, but^with r^dud'edVstope 
i . ' L»iJ ''It was .vill be cancelled 

.;7~- ^' ■■^ '■ 




• I i ^ ^her.> departments, at your Vinstit^utiSn. V ' 
V > ji^ In other; coiiegls ; or^nivejrai ties'. ; ■ " ' ■ ■ 'f' 



\ : 



OTHER 



• dl ■■ i^^i^^viee-piresidexit , dean, . Jirect.or of-'-QoSn'sJling center-,- etc .-> .•■ 

v .r;: ■ ■ Specif y'.; ' " " ' ' ' ' ' " ' " ^ - 



\ ■ . *■ 



